JUnit version 4.13.2
.23:47:31.751 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468051743
23:47:31.775 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468051775
23:47:31.806 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:47:31.810 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:47:31.873 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:47:31.886 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:47:31.893 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:47:31.897 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:47:32.117 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:47:32.393 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:32.394 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:47:32.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.398272  2217 mini_oidc.cc:150] Starting JWKS server
23:47:32.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.401156  2217 webserver.cc:534] Webserver started at http://127.0.0.1:36575/ using document root <none> and password file <none>
23:47:32.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.401440  2217 mini_oidc.cc:186] Starting OIDC Discovery server
23:47:32.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.402117  2217 webserver.cc:534] Webserver started at http://127.0.0.1:35041/ using document root <none> and password file <none>
23:47:32.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:32Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:47:32.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:32Z Disabled control of system clock
23:47:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.436870  2217 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:32.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal
23:47:32.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data
23:47:32.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:32.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:32.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/logs
23:47:32.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data/info.pb
23:47:32.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:32.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:32.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:32.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:32.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:32.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:32.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:32.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:32.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:32.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:32.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:32.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:32.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.126:45489
23:47:32.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.126
23:47:32.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:32.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:32.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:32.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:32.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:32.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:32.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:32.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:32.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36575/jwks.json with env {}
23:47:32.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.787591  2228 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:32.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.788122  2228 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:32.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.788244  2228 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:32.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.797405  2228 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:32.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.797547  2228 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:32.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.797629  2228 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:32.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.797689  2228 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:32.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.797773  2228 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:32.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.797823  2228 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36575/jwks.json
23:47:32.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.809128  2228 master_runner.cc:387] Master server non-default flags:
23:47:32.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:32.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:32.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:32.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:32.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data
23:47:32.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal
23:47:32.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:32.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:32.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:32.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:32.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:32.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.126:45489
23:47:32.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:32.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:32.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:32.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36575/jwks.json
23:47:32.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:32.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:32.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data/info.pb
23:47:32.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.126
23:47:32.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:32.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:32.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:32.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:32.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:32.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:32.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/logs
23:47:32.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:32.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:32.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:32.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:32.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:32.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:32.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:32.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:32.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:32.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:32.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.811725  2228 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:32.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.814764  2228 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:32.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.825838  2234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:32.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.826122  2236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:32.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.825865  2233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:32.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.827541  2228 server_base.cc:1061] running on GCE node
23:47:32.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.828364  2228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:32.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.830085  2228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:32.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.831382  2228 hybrid_clock.cc:648] HybridClock initialized: now 1783468052831315 us; error 56 us; skew 500 ppm
23:47:32.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.832007  2228 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:32.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.834677  2228 webserver.cc:534] Webserver started at http://127.2.42.126:34693/ using document root <none> and password file <none>
23:47:32.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.835829  2228 fs_manager.cc:362] Metadata directory not provided
23:47:32.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.836001  2228 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:32.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.836490  2228 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:32.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.839457  2228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data/instance:
23:47:32.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "419915d6bfce45aa8bdb5ba388a39674"
23:47:32.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:32 on dist-test-slave-hfsf"
23:47:32.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.840548  2228 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal/instance:
23:47:32.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "419915d6bfce45aa8bdb5ba388a39674"
23:47:32.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:32 on dist-test-slave-hfsf"
23:47:32.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.847690  2228 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
23:47:32.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.851745  2242 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:32.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.853233  2228 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
23:47:32.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.853430  2228 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal
23:47:32.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "419915d6bfce45aa8bdb5ba388a39674"
23:47:32.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:32 on dist-test-slave-hfsf"
23:47:32.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.853691  2228 fs_report.cc:389] FS layout report
23:47:32.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:32.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal
23:47:32.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal
23:47:32.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data/data
23:47:32.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:32.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:32.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:32.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:32.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:32.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:32.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:32.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:32.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.892022  2228 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:32.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.893289  2228 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:32.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.893656  2228 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:32.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.916697  2228 rpc_server.cc:307] RPC server started. Bound to: 127.2.42.126:45489
23:47:32.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.916739  2294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.42.126:45489 every 8 connection(s)
23:47:32.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.918794  2228 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/data/info.pb
23:47:32.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.919982  2217 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2228
23:47:32.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.920336  2217 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-0/wal/instance
23:47:32.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.923291  2217 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:32.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:32.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal
23:47:32.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data
23:47:32.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:32.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:32.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:32.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:32.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:32.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:32.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/logs
23:47:32.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data/info.pb
23:47:32.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:32.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:32.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:32.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:32.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:32.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.125:42983
23:47:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.125
23:47:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:32.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:32.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:32.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:32.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:32.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36575/jwks.json with env {}
23:47:32.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.924970  2295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:32.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.933452  2295 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } has no permanent_uuid. Determining permanent_uuid...
23:47:32.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:32.952688  2295 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } has no permanent_uuid. Determining permanent_uuid...
23:47:32.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.954169  2246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.42.125:42983: connect: Connection refused (error 111)
23:47:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:32.956058  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.125:42983: Network error: Client connection negotiation failed: client connection to 127.2.42.125:42983: connect: Connection refused (error 111)
23:47:33.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.005440  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } attempt: 1
23:47:33.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.008045  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.125:42983: Network error: Client connection negotiation failed: client connection to 127.2.42.125:42983: connect: Connection refused (error 111)
23:47:33.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.076488  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } attempt: 2
23:47:33.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.079234  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.125:42983: Network error: Client connection negotiation failed: client connection to 127.2.42.125:42983: connect: Connection refused (error 111)
23:47:33.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.170568  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } attempt: 3
23:47:33.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.173071  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.125:42983: Network error: Client connection negotiation failed: client connection to 127.2.42.125:42983: connect: Connection refused (error 111)
23:47:33.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.277480  2298 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:33.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.277824  2298 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:33.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.277908  2298 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.286468  2298 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.286583  2298 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.286644  2298 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.286684  2298 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.286737  2298 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.286772  2298 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36575/jwks.json
23:47:33.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.297658  2298 master_runner.cc:387] Master server non-default flags:
23:47:33.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:33.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data
23:47:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal
23:47:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.125:42983
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36575/jwks.json
23:47:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data/info.pb
23:47:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.125
23:47:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:33.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:33.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:33.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:33.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:33.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:33.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/logs
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:33.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:33.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:33.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:33.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.299825  2298 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:33.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.302177  2298 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:33.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.312173  2306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:33.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.312180  2307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:33.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.316394  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } attempt: 4
23:47:33.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.317680  2309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:33.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.318439  2298 server_base.cc:1061] running on GCE node
23:47:33.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.318825  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.125:42983: Network error: Client connection negotiation failed: client connection to 127.2.42.125:42983: connect: Connection refused (error 111)
23:47:33.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.319473  2298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:33.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.321221  2298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:33.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.322500  2298 hybrid_clock.cc:648] HybridClock initialized: now 1783468053322449 us; error 32 us; skew 500 ppm
23:47:33.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.323102  2298 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:33.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.327003  2298 webserver.cc:534] Webserver started at http://127.2.42.125:38935/ using document root <none> and password file <none>
23:47:33.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.327924  2298 fs_manager.cc:362] Metadata directory not provided
23:47:33.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.328075  2298 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:33.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.328572  2298 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:33.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.331202  2298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data/instance:
23:47:33.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bbe6547fe07846b19600923c95f4f746"
23:47:33.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:33 on dist-test-slave-hfsf"
23:47:33.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.332242  2298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal/instance:
23:47:33.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bbe6547fe07846b19600923c95f4f746"
23:47:33.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:33 on dist-test-slave-hfsf"
23:47:33.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.338374  2298 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
23:47:33.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.342335  2315 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:33.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.344030  2298 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
23:47:33.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.344251  2298 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal
23:47:33.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bbe6547fe07846b19600923c95f4f746"
23:47:33.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:33 on dist-test-slave-hfsf"
23:47:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.344511  2298 fs_report.cc:389] FS layout report
23:47:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal
23:47:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal
23:47:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data/data
23:47:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:33.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:33.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:33.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:33.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.372996  2298 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:33.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.374198  2298 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:33.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.374550  2298 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:33.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.396167  2298 rpc_server.cc:307] RPC server started. Bound to: 127.2.42.125:42983
23:47:33.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.396202  2366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.42.125:42983 every 8 connection(s)
23:47:33.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.398005  2298 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/data/info.pb
23:47:33.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.402740  2217 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2298
23:47:33.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.402941  2217 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-1/wal/instance
23:47:33.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.403174  2367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:33.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.404238  2217 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:33.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:33.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal
23:47:33.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data
23:47:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/logs
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data/info.pb
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.124:36407
23:47:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.124
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36575/jwks.json with env {}
23:47:33.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.413252  2367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.435602  2367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.445616  2367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.447018  2318 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.448808  2367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.498171  2367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 1
23:47:33.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.501202  2367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.569523  2367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 2
23:47:33.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.572167  2367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.618117  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } attempt: 5
23:47:33.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.625594  2295 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.627797  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.663439  2367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 3
23:47:33.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.665966  2367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.679049  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 1
23:47:33.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.681417  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.749697  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 2
23:47:33.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.752276  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.772142  2369 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:33.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.772496  2369 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:33.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.772581  2369 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:33.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.781123  2369 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:33.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.781239  2369 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.781297  2369 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.781342  2369 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.781435  2369 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.781499  2369 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36575/jwks.json
23:47:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.791703  2369 master_runner.cc:387] Master server non-default flags:
23:47:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:33.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.124:36407
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36575/jwks.json
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data/info.pb
23:47:33.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.124
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/logs
23:47:33.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:33.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:33.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:33.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.793905  2369 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:33.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.796504  2369 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:33.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.806630  2377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:33.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.806918  2378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:33.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.808156  2369 server_base.cc:1061] running on GCE node
23:47:33.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.808418  2380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:33.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.809248  2367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 4
23:47:33.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.809428  2369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.811441  2369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.811450  2367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.812682  2369 hybrid_clock.cc:648] HybridClock initialized: now 1783468053812606 us; error 59 us; skew 500 ppm
23:47:33.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.813078  2369 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.815852  2369 webserver.cc:534] Webserver started at http://127.2.42.124:36935/ using document root <none> and password file <none>
23:47:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.816603  2369 fs_manager.cc:362] Metadata directory not provided
23:47:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.816701  2369 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.817015  2369 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:33.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.819530  2369 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data/instance:
23:47:33.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4670cbec97cf4349b34db507f6fc62cf"
23:47:33.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:33 on dist-test-slave-hfsf"
23:47:33.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.820277  2369 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal/instance:
23:47:33.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4670cbec97cf4349b34db507f6fc62cf"
23:47:33.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:33 on dist-test-slave-hfsf"
23:47:33.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.826309  2369 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:47:33.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.830173  2386 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.831840  2369 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.832041  2369 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4670cbec97cf4349b34db507f6fc62cf"
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:33 on dist-test-slave-hfsf"
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.832230  2369 fs_report.cc:389] FS layout report
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data/data
23:47:33.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:33.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:33.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.855154  2369 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.856071  2369 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.856308  2369 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:33.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.858599  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 3
23:47:33.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.860857  2295 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.42.124:36407: Network error: Client connection negotiation failed: client connection to 127.2.42.124:36407: connect: Connection refused (error 111)
23:47:33.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.878710  2369 rpc_server.cc:307] RPC server started. Bound to: 127.2.42.124:36407
23:47:33.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.878724  2438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.42.124:36407 every 8 connection(s)
23:47:33.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.880317  2369 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/data/info.pb
23:47:33.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.885129  2217 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2369
23:47:33.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.885345  2217 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/master-2/wal/instance
23:47:33.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.885877  2439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:33.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.895713  2439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.914573  2439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.924525  2439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } has no permanent_uuid. Determining permanent_uuid...
23:47:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.935869  2439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: Bootstrap starting.
23:47:33.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.940382  2439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: Neither blocks nor log segments found. Creating new log.
23:47:33.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.941807  2439 log.cc:826] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: Log is configured to *not* fsync() on all Append() calls
23:47:33.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.945330  2439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: No bootstrap required, opened a new log
23:47:33.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.951318  2439 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.951699  2439 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.951792  2439 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4670cbec97cf4349b34db507f6fc62cf, State: Initialized, Role: FOLLOWER
23:47:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.952546  2439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:33.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.953644  2446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:33.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.953920  2446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: This master's current role is: FOLLOWER
23:47:33.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.955125  2439 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: configured and running, proceeding with master startup.
23:47:33.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.966939  2457 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:33.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:33.967654  2457 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:33.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.963166  2369 master_runner.cc:187] Error getting master registration for 127.2.42.126:45489: OK, instance_id { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" instance_seqno: 1783468052910629 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:33.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:33.968864  2369 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:34.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.038131  2295 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 4
23:47:34.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.049207  2295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: Bootstrap starting.
23:47:34.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.053076  2295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: Neither blocks nor log segments found. Creating new log.
23:47:34.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.054207  2295 log.cc:826] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: Log is configured to *not* fsync() on all Append() calls
23:47:34.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.057094  2295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: No bootstrap required, opened a new log
23:47:34.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.062598  2295 raft_consensus.cc:359] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.062963  2295 raft_consensus.cc:385] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:34.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.063062  2295 raft_consensus.cc:740] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419915d6bfce45aa8bdb5ba388a39674, State: Initialized, Role: FOLLOWER
23:47:34.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.063716  2295 consensus_queue.cc:260] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.068425  2460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.069304  2460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: This master's current role is: FOLLOWER
23:47:34.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.069902  2295 sys_catalog.cc:565] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: configured and running, proceeding with master startup.
23:47:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.088411  2471 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.089139  2471 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:34.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.083977  2228 master_runner.cc:187] Error getting master registration for 127.2.42.125:42983: OK, instance_id { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" instance_seqno: 1783468053390015 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:34.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.091362  2228 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:34.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.108412  2393 tablet.cc:2406] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:34.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.110678  2367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } attempt: 5
23:47:34.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.124087  2367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: Bootstrap starting.
23:47:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.130165  2367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: Neither blocks nor log segments found. Creating new log.
23:47:34.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.131698  2367 log.cc:826] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: Log is configured to *not* fsync() on all Append() calls
23:47:34.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.135107  2367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: No bootstrap required, opened a new log
23:47:34.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.143568  2367 raft_consensus.cc:359] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.144016  2367 raft_consensus.cc:385] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:34.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.144147  2367 raft_consensus.cc:740] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe6547fe07846b19600923c95f4f746, State: Initialized, Role: FOLLOWER
23:47:34.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.145040  2367 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.146262  2474 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.148061  2248 tablet.cc:2406] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:34.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.147696  2367 sys_catalog.cc:565] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: configured and running, proceeding with master startup.
23:47:34.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.150583  2474 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: This master's current role is: FOLLOWER
23:47:34.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.191040  2485 catalog_manager.cc:1593] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:34.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.191784  2485 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:34.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.196770  2298 master_runner.cc:264] No leader master found from master bbe6547fe07846b19600923c95f4f746
23:47:34.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.196907  2298 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:34.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.218096  2446 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:34.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.218443  2446 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.221252  2446 leader_election.cc:290] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 419915d6bfce45aa8bdb5ba388a39674 (127.2.42.126:45489), bbe6547fe07846b19600923c95f4f746 (127.2.42.125:42983)
23:47:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.222746  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4670cbec97cf4349b34db507f6fc62cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe6547fe07846b19600923c95f4f746" is_pre_election: true
23:47:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.223733  2342 raft_consensus.cc:2468] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4670cbec97cf4349b34db507f6fc62cf in term 0.
23:47:34.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.224452  2391 leader_election.cc:304] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4670cbec97cf4349b34db507f6fc62cf, bbe6547fe07846b19600923c95f4f746; no voters: 
23:47:34.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.225849  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4670cbec97cf4349b34db507f6fc62cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419915d6bfce45aa8bdb5ba388a39674" is_pre_election: true
23:47:34.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.226353  2270 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4670cbec97cf4349b34db507f6fc62cf in term 0.
23:47:34.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.232282  2446 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:34.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.232491  2446 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:34.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.232594  2446 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 0 FOLLOWER]: Advancing to term 1
23:47:34.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.237555  2446 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.240031  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4670cbec97cf4349b34db507f6fc62cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe6547fe07846b19600923c95f4f746"
23:47:34.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.240290  2342 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 0 FOLLOWER]: Advancing to term 1
23:47:34.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.243083  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4670cbec97cf4349b34db507f6fc62cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419915d6bfce45aa8bdb5ba388a39674"
23:47:34.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.243347  2270 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 0 FOLLOWER]: Advancing to term 1
23:47:34.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.247023  2270 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4670cbec97cf4349b34db507f6fc62cf in term 1.
23:47:34.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.247710  2390 leader_election.cc:304] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 419915d6bfce45aa8bdb5ba388a39674, 4670cbec97cf4349b34db507f6fc62cf; no voters: 
23:47:34.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.251603  2342 raft_consensus.cc:2468] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4670cbec97cf4349b34db507f6fc62cf in term 1.
23:47:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.259444  2446 leader_election.cc:290] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [CANDIDATE]: Term 1 election: Requested vote from peers 419915d6bfce45aa8bdb5ba388a39674 (127.2.42.126:45489), bbe6547fe07846b19600923c95f4f746 (127.2.42.125:42983)
23:47:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.259775  2446 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 1 FOLLOWER]: Leader election won for term 1
23:47:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.259935  2446 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [term 1 LEADER]: Becoming Leader. State: Replica: 4670cbec97cf4349b34db507f6fc62cf, State: Running, Role: LEADER
23:47:34.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.262583  2446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } }
23:47:34.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.274201  2487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4670cbec97cf4349b34db507f6fc62cf. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.275074  2487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: This master's current role is: LEADER
23:47:34.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.282419  2489 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:47:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.290917  2489 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:47:34.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.308458  2342 raft_consensus.cc:1275] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [term 1 FOLLOWER]: Refusing update from remote peer 4670cbec97cf4349b34db507f6fc62cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.310220  2487 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:34.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.322074  2270 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [term 1 FOLLOWER]: Refusing update from remote peer 4670cbec97cf4349b34db507f6fc62cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:34.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.323890  2487 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:34.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.353134  2460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4670cbec97cf4349b34db507f6fc62cf. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.353451  2460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: This master's current role is: FOLLOWER
23:47:34.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.358372  2474 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4670cbec97cf4349b34db507f6fc62cf. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.358744  2474 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: This master's current role is: FOLLOWER
23:47:34.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.360339  2490 mvcc.cc:204] Tried to move back new op lower bound from 7305085150432051200 to 7305085150273978368. Current Snapshot: MvccSnapshot[applied={T|T < 7305085150432051200}]
23:47:34.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.362311  2492 mvcc.cc:204] Tried to move back new op lower bound from 7305085150432051200 to 7305085150273978368. Current Snapshot: MvccSnapshot[applied={T|T < 7305085150432051200}]
23:47:34.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.370083  2460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.370419  2460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674 [sys.catalog]: This master's current role is: FOLLOWER
23:47:34.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.377240  2446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.377558  2446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: This master's current role is: LEADER
23:47:34.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.381462  2489 catalog_manager.cc:1382] Generated new cluster ID: e1b81c4078434aa5ab17021fe4f533a8
23:47:34.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.381600  2489 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:47:34.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.383098  2487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.383625  2487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf [sys.catalog]: This master's current role is: LEADER
23:47:34.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.389681  2474 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4670cbec97cf4349b34db507f6fc62cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419915d6bfce45aa8bdb5ba388a39674" member_type: VOTER last_known_addr { host: "127.2.42.126" port: 45489 } } peers { permanent_uuid: "bbe6547fe07846b19600923c95f4f746" member_type: VOTER last_known_addr { host: "127.2.42.125" port: 42983 } } peers { permanent_uuid: "4670cbec97cf4349b34db507f6fc62cf" member_type: VOTER last_known_addr { host: "127.2.42.124" port: 36407 } } }
23:47:34.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.389923  2474 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746 [sys.catalog]: This master's current role is: FOLLOWER
23:47:34.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.436498  2489 catalog_manager.cc:1405] Generated new certificate authority record
23:47:34.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.439540  2489 catalog_manager.cc:1539] Loading token signing keys...
23:47:34.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.470405  2489 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 4670cbec97cf4349b34db507f6fc62cf: Generated new TSK 0
23:47:34.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.472436  2489 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:47:34.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.501700  2217 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:34.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/logs
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data/info.pb
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:34.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.65:0
23:47:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.42.65
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.65
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:34.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:34.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.964612  2499 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:34.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.965031  2499 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:34.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.965153  2499 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:34.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.974463  2499 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:34.974741  2499 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.42.65
23:47:34.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.985471  2499 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.65:0
23:47:34.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data/info.pb
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.65
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.42.65
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/logs
23:47:34.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:34.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.987958  2499 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:34.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:34.990150  2499 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:35.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.000754  2507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:35.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.000808  2504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:35.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.000931  2505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:35.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.002678  2499 server_base.cc:1061] running on GCE node
23:47:35.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.003402  2499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:35.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.004637  2499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:35.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.005878  2499 hybrid_clock.cc:648] HybridClock initialized: now 1783468055005821 us; error 50 us; skew 500 ppm
23:47:35.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.006296  2499 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:35.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.009068  2499 webserver.cc:534] Webserver started at http://127.2.42.65:33327/ using document root <none> and password file <none>
23:47:35.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.009826  2499 fs_manager.cc:362] Metadata directory not provided
23:47:35.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.009931  2499 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:35.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.010325  2499 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:35.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.013172  2499 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data/instance:
23:47:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5166c0ced7204d998d8062d51526bfbd"
23:47:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:35 on dist-test-slave-hfsf"
23:47:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.014297  2499 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal/instance:
23:47:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5166c0ced7204d998d8062d51526bfbd"
23:47:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:35 on dist-test-slave-hfsf"
23:47:35.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.020429  2499 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
23:47:35.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.024066  2514 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:35.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.025609  2499 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.025846  2499 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5166c0ced7204d998d8062d51526bfbd"
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:35 on dist-test-slave-hfsf"
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.026154  2499 fs_report.cc:389] FS layout report
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data/data
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:35.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.040318  2499 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:35.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.041332  2499 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:35.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.041682  2499 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:35.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.042788  2499 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:35.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.044651  2499 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:35.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.044780  2499 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:35.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.044885  2499 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:35.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.044960  2499 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:35.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.079947  2627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.42.65:39257 every 8 connection(s)
23:47:35.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.079916  2499 rpc_server.cc:307] RPC server started. Bound to: 127.2.42.65:39257
23:47:35.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.081737  2499 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/data/info.pb
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.090076  2217 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2499
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.090322  2217 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-0/wal/instance
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.091859  2471 catalog_manager.cc:1294] Loaded cluster ID: e1b81c4078434aa5ab17021fe4f533a8
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.091955  2471 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: loading cluster ID for follower catalog manager: success
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.096084  2471 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: acquiring CA information for follower catalog manager: success
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.096539  2217 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data
23:47:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/logs
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data/info.pb
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.66:0
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.42.66
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.66
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:35.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.105260  2471 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 419915d6bfce45aa8bdb5ba388a39674: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:35.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.121510  2630 heartbeater.cc:344] Connected to a master server at 127.2.42.125:42983
23:47:35.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.121783  2628 heartbeater.cc:344] Connected to a master server at 127.2.42.124:36407
23:47:35.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.121996  2630 heartbeater.cc:461] Registering TS with master...
23:47:35.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.121999  2628 heartbeater.cc:461] Registering TS with master...
23:47:35.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.123420  2628 heartbeater.cc:507] Master 127.2.42.124:36407 requested a full tablet report, sending...
23:47:35.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.124095  2630 heartbeater.cc:507] Master 127.2.42.125:42983 requested a full tablet report, sending...
23:47:35.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.126705  2404 ts_manager.cc:194] Registered new tserver with Master: 5166c0ced7204d998d8062d51526bfbd (127.2.42.65:39257)
23:47:35.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.128238  2332 ts_manager.cc:194] Registered new tserver with Master: 5166c0ced7204d998d8062d51526bfbd (127.2.42.65:39257)
23:47:35.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.128966  2404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.42.65:53823
23:47:35.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.130775  2629 heartbeater.cc:344] Connected to a master server at 127.2.42.126:45489
23:47:35.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.130961  2629 heartbeater.cc:461] Registering TS with master...
23:47:35.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.131544  2629 heartbeater.cc:507] Master 127.2.42.126:45489 requested a full tablet report, sending...
23:47:35.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.133297  2259 ts_manager.cc:194] Registered new tserver with Master: 5166c0ced7204d998d8062d51526bfbd (127.2.42.65:39257)
23:47:35.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.194074  2485 catalog_manager.cc:1294] Loaded cluster ID: e1b81c4078434aa5ab17021fe4f533a8
23:47:35.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.194224  2485 catalog_manager.cc:1587] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: loading cluster ID for follower catalog manager: success
23:47:35.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.197081  2485 catalog_manager.cc:1609] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: acquiring CA information for follower catalog manager: success
23:47:35.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.199031  2485 catalog_manager.cc:1637] T 00000000000000000000000000000000 P bbe6547fe07846b19600923c95f4f746: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:35.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.475160  2636 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:35.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.475518  2636 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:35.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.475610  2636 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:35.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.485220  2636 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:35.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.485402  2636 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.42.66
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.495946  2636 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.66:0
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data/info.pb
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.66
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.42.66
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/logs
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:35.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:35.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.497655  2636 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:35.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.499781  2636 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.510589  2644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.510565  2643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.511396  2646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:35.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.512519  2636 server_base.cc:1061] running on GCE node
23:47:35.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.513185  2636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:35.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.514438  2636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:35.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.515734  2636 hybrid_clock.cc:648] HybridClock initialized: now 1783468055515685 us; error 39 us; skew 500 ppm
23:47:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.516180  2636 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.518751  2636 webserver.cc:534] Webserver started at http://127.2.42.66:40643/ using document root <none> and password file <none>
23:47:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.519773  2636 fs_manager.cc:362] Metadata directory not provided
23:47:35.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.519923  2636 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:35.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.520385  2636 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:35.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.523332  2636 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data/instance:
23:47:35.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9"
23:47:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:35 on dist-test-slave-hfsf"
23:47:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.524276  2636 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal/instance:
23:47:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9"
23:47:35.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:35 on dist-test-slave-hfsf"
23:47:35.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.530747  2636 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
23:47:35.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.535315  2652 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.536844  2636 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.537002  2636 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9"
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:35 on dist-test-slave-hfsf"
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.537179  2636 fs_report.cc:389] FS layout report
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data/data
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:35.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.554956  2636 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:35.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.555850  2636 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:35.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.556154  2636 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:35.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.557181  2636 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:35.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.558952  2636 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:35.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.559042  2636 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:35.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.559114  2636 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:35.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.559160  2636 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:35.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.596297  2636 rpc_server.cc:307] RPC server started. Bound to: 127.2.42.66:39741
23:47:35.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.596355  2765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.42.66:39741 every 8 connection(s)
23:47:35.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.597797  2636 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/data/info.pb
23:47:35.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.603426  2217 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2636
23:47:35.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.603621  2217 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-1/wal/instance
23:47:35.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.607875  2217 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:35.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:35.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal
23:47:35.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data
23:47:35.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:35.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/logs
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data/info.pb
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.67:0
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.42.67
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.67
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:35.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:35.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.618086  2766 heartbeater.cc:344] Connected to a master server at 127.2.42.124:36407
23:47:35.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.618501  2766 heartbeater.cc:461] Registering TS with master...
23:47:35.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.619608  2768 heartbeater.cc:344] Connected to a master server at 127.2.42.125:42983
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.619822  2768 heartbeater.cc:461] Registering TS with master...
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.619835  2766 heartbeater.cc:507] Master 127.2.42.124:36407 requested a full tablet report, sending...
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.620421  2768 heartbeater.cc:507] Master 127.2.42.125:42983 requested a full tablet report, sending...
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.621677  2404 ts_manager.cc:194] Registered new tserver with Master: b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741)
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.621778  2767 heartbeater.cc:344] Connected to a master server at 127.2.42.126:45489
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.621898  2767 heartbeater.cc:461] Registering TS with master...
23:47:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.622380  2767 heartbeater.cc:507] Master 127.2.42.126:45489 requested a full tablet report, sending...
23:47:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.622918  2404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.42.66:55413
23:47:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.623560  2259 ts_manager.cc:194] Registered new tserver with Master: b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741)
23:47:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.623545  2332 ts_manager.cc:194] Registered new tserver with Master: b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741)
23:47:35.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.972888  2773 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:35.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.973199  2773 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:35.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.973291  2773 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:35.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.981921  2773 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:35.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:35.982100  2773 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.42.67
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.993178  2773 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.42.84:41857
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal
23:47:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.42.67:0
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data/info.pb
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.42.67
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.42.67
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/logs
23:47:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.995182  2773 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:35.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:35.997112  2773 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:36.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:36.007925  2778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:36.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:36.007809  2779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:36.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:36.008970  2781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:36.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.009550  2773 server_base.cc:1061] running on GCE node
23:47:36.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.010351  2773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:36.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.011641  2773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:36.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.012923  2773 hybrid_clock.cc:648] HybridClock initialized: now 1783468056012839 us; error 66 us; skew 500 ppm
23:47:36.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.013401  2773 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:36.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.016067  2773 webserver.cc:534] Webserver started at http://127.2.42.67:33795/ using document root <none> and password file <none>
23:47:36.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.016995  2773 fs_manager.cc:362] Metadata directory not provided
23:47:36.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.017139  2773 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:36.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.017588  2773 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:36.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.020259  2773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data/instance:
23:47:36.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a910d7b024e4df2993580f4f2923bb5"
23:47:36.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:36 on dist-test-slave-hfsf"
23:47:36.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.021174  2773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal/instance:
23:47:36.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a910d7b024e4df2993580f4f2923bb5"
23:47:36.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:36 on dist-test-slave-hfsf"
23:47:36.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.027344  2773 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
23:47:36.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.031303  2787 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.033200  2773 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:47:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.033429  2773 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal
23:47:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a910d7b024e4df2993580f4f2923bb5"
23:47:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:36 on dist-test-slave-hfsf"
23:47:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.033746  2773 fs_report.cc:389] FS layout report
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data/data
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:36.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.073210  2773 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:36.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.074285  2773 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:36.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.074647  2773 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:36.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.075785  2773 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:36.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.077819  2773 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:36.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.077951  2773 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:36.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.078061  2773 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:36.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.078140  2773 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.115650  2773 rpc_server.cc:307] RPC server started. Bound to: 127.2.42.67:34367
23:47:36.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.115763  2901 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.42.67:34367 every 8 connection(s)
23:47:36.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.117396  2773 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/data/info.pb
23:47:36.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.119601  2217 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2773
23:47:36.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.119787  2217 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster5492563752039398634/ts-2/wal/instance
23:47:36.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.133327  2628 heartbeater.cc:499] Master 127.2.42.124:36407 was elected leader, sending a full tablet report...
23:47:36.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.140558  2904 heartbeater.cc:344] Connected to a master server at 127.2.42.125:42983
23:47:36.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.141079  2904 heartbeater.cc:461] Registering TS with master...
23:47:36.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.143116  2904 heartbeater.cc:507] Master 127.2.42.125:42983 requested a full tablet report, sending...
23:47:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.145634  2332 ts_manager.cc:194] Registered new tserver with Master: 7a910d7b024e4df2993580f4f2923bb5 (127.2.42.67:34367)
23:47:36.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.147470  2902 heartbeater.cc:344] Connected to a master server at 127.2.42.124:36407
23:47:36.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.147641  2902 heartbeater.cc:461] Registering TS with master...
23:47:36.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.147913  2903 heartbeater.cc:344] Connected to a master server at 127.2.42.126:45489
23:47:36.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.148089  2903 heartbeater.cc:461] Registering TS with master...
23:47:36.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.148335  2902 heartbeater.cc:507] Master 127.2.42.124:36407 requested a full tablet report, sending...
23:47:36.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.148710  2903 heartbeater.cc:507] Master 127.2.42.126:45489 requested a full tablet report, sending...
23:47:36.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.149780  2404 ts_manager.cc:194] Registered new tserver with Master: 7a910d7b024e4df2993580f4f2923bb5 (127.2.42.67:34367)
23:47:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.150033  2259 ts_manager.cc:194] Registered new tserver with Master: 7a910d7b024e4df2993580f4f2923bb5 (127.2.42.67:34367)
23:47:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.150923  2404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.42.67:41379
23:47:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.157485  2217 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:47:36.160 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:36.161 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:47:36.170 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.42.126"
      port: 45489
    }
    bound_http_address {
      host: "127.2.42.126"
      port: 34693
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.42.125"
      port: 42983
    }
    bound_http_address {
      host: "127.2.42.125"
      port: 38935
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.42.124"
      port: 36407
    }
    bound_http_address {
      host: "127.2.42.124"
      port: 36935
    }
  }
}

23:47:36.174 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:47:36.176 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.42.65"
      port: 39257
    }
    bound_http_address {
      host: "127.2.42.65"
      port: 33327
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.42.66"
      port: 39741
    }
    bound_http_address {
      host: "127.2.42.66"
      port: 40643
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.42.67"
      port: 34367
    }
    bound_http_address {
      host: "127.2.42.67"
      port: 33795
    }
  }
}

23:47:36.176 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:47:36.191 [DEBUG - main] (InternalLoggerFactory.java:63) Using SLF4J as the default logging framework
23:47:36.197 [DEBUG - main] (ResourceLeakDetector.java:129) -Dorg.apache.kudu.shaded.io.netty.leakDetection.level: simple
23:47:36.197 [DEBUG - main] (ResourceLeakDetector.java:130) -Dorg.apache.kudu.shaded.io.netty.leakDetection.targetRecords: 4
23:47:36.203 [DEBUG - main] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@403f0a22
23:47:36.240 [DEBUG - main] (PlatformDependent0.java:1138) Java version: 17
23:47:36.241 [DEBUG - main] (PlatformDependent0.java:616) -Dio.netty.noUnsafe: false
23:47:36.241 [DEBUG - main] (PlatformDependent0.java:559) Thread.isVirtual() is not available: 
23:47:36.242 [DEBUG - main] (PlatformDependent0.java:572) java.lang.BaseVirtualThread is not available: 
23:47:36.243 [DEBUG - main] (PlatformDependent0.java:145) sun.misc.Unsafe.theUnsafe: available
23:47:36.244 [DEBUG - main] (PlatformDependent0.java:208) sun.misc.Unsafe base methods: all available
23:47:36.244 [DEBUG - main] (PlatformDependent0.java:240) sun.misc.Unsafe.storeFence: available
23:47:36.245 [DEBUG - main] (PlatformDependent0.java:283) java.nio.Buffer.address: available
23:47:36.245 [DEBUG - main] (PlatformDependent0.java:369) direct buffer constructor: unavailable: Reflective setAccessible(true) disabled
23:47:36.246 [DEBUG - main] (PlatformDependent0.java:447) java.nio.Bits.unaligned: available, true
23:47:36.248 [DEBUG - main] (PlatformDependent0.java:515) jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable: class org.apache.kudu.shaded.io.netty.util.internal.PlatformDependent0$7 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @589b3632
23:47:36.250 [DEBUG - main] (PlatformDependent0.java:545) java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable
23:47:36.250 [DEBUG - main] (PlatformDependent.java:1214) sun.misc.Unsafe: available
23:47:36.250 [DEBUG - main] (PlatformDependent.java:1360) -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
23:47:36.250 [DEBUG - main] (PlatformDependent.java:1439) -Dio.netty.bitMode: 64 (sun.arch.data.model)
23:47:36.252 [DEBUG - main] (PlatformDependent.java:181) -Dio.netty.maxDirectMemory: -1 bytes
23:47:36.252 [DEBUG - main] (PlatformDependent.java:188) -Dio.netty.uninitializedArrayAllocationThreshold: -1
23:47:36.253 [DEBUG - main] (CleanerJava9.java:71) java.nio.ByteBuffer.cleaner(): available
23:47:36.253 [DEBUG - main] (PlatformDependent.java:209) -Dio.netty.noPreferDirect: false
23:47:36.265 [DEBUG - main] (PlatformDependent.java:1048) org.jctools-core.MpscChunkedArrayQueue: available
23:47:36.314 [DEBUG - main] (MultithreadEventLoopGroup.java:44) -Dio.netty.eventLoopThreads: 8
23:47:36.328 [DEBUG - main] (GlobalEventExecutor.java:54) -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1
23:47:36.335 [DEBUG - main] (InternalThreadLocalMap.java:100) -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
23:47:36.335 [DEBUG - main] (InternalThreadLocalMap.java:101) -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
23:47:36.345 [DEBUG - main] (NioEventLoop.java:110) -Dio.netty.noKeySetOptimization: false
23:47:36.345 [DEBUG - main] (NioEventLoop.java:111) -Dio.netty.selectorAutoRebuildThreshold: 512
23:47:36.396 [DEBUG - main] (PooledByteBufAllocator.java:161) -Dio.netty.allocator.numHeapArenas: 8
23:47:36.396 [DEBUG - main] (PooledByteBufAllocator.java:162) -Dio.netty.allocator.numDirectArenas: 8
23:47:36.396 [DEBUG - main] (PooledByteBufAllocator.java:164) -Dio.netty.allocator.pageSize: 8192
23:47:36.396 [DEBUG - main] (PooledByteBufAllocator.java:169) -Dio.netty.allocator.maxOrder: 9
23:47:36.396 [DEBUG - main] (PooledByteBufAllocator.java:173) -Dio.netty.allocator.chunkSize: 4194304
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:174) -Dio.netty.allocator.smallCacheSize: 256
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:175) -Dio.netty.allocator.normalCacheSize: 64
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:176) -Dio.netty.allocator.maxCachedBufferCapacity: 32768
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:177) -Dio.netty.allocator.cacheTrimInterval: 8192
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:178) -Dio.netty.allocator.cacheTrimIntervalMillis: 0
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:179) -Dio.netty.allocator.useCacheForAllThreads: false
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:180) -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
23:47:36.397 [DEBUG - main] (PooledByteBufAllocator.java:182) -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false
23:47:36.420 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
23:47:36.483 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:36.569 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:47:36.569 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:47:36.570 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:47:36.570 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:47:36.578 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:47:36.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.626962  2766 heartbeater.cc:499] Master 127.2.42.124:36407 was elected leader, sending a full tablet report...
23:47:36.931 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:36.931 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:47:36.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.934419  2913 mini_oidc.cc:150] Starting JWKS server
23:47:36.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.936990  2913 webserver.cc:534] Webserver started at http://127.0.0.1:36731/ using document root <none> and password file <none>
23:47:36.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.937314  2913 mini_oidc.cc:186] Starting OIDC Discovery server
23:47:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.938020  2913 webserver.cc:534] Webserver started at http://127.0.0.1:41129/ using document root <none> and password file <none>
23:47:36.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:36Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:47:36.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:36Z Disabled control of system clock
23:47:36.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:36.967378  2913 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:36.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:36.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal
23:47:36.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/logs
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data/info.pb
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:36.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.126:46485
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.126
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36731/jwks.json with env {}
23:47:37.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.153836  2902 heartbeater.cc:499] Master 127.2.42.124:36407 was elected leader, sending a full tablet report...
23:47:37.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.321660  2925 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:37.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.321979  2925 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:37.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.322057  2925 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:37.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.330284  2925 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:37.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.330394  2925 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:37.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.330449  2925 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:37.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.330490  2925 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:37.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.330542  2925 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:37.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.330576  2925 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36731/jwks.json
23:47:37.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.341240  2925 master_runner.cc:387] Master server non-default flags:
23:47:37.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:37.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:37.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:37.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.126:46485
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36731/jwks.json
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data/info.pb
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.126
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:37.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/logs
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:37.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.343362  2925 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:37.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.345855  2925 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:37.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.355564  2930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:37.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.356284  2933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:37.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.355729  2931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:37.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.357228  2925 server_base.cc:1061] running on GCE node
23:47:37.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.358078  2925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:37.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.359843  2925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:37.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.361171  2925 hybrid_clock.cc:648] HybridClock initialized: now 1783468057361110 us; error 44 us; skew 500 ppm
23:47:37.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.361639  2925 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:37.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.364240  2925 webserver.cc:534] Webserver started at http://127.2.216.126:34281/ using document root <none> and password file <none>
23:47:37.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.365103  2925 fs_manager.cc:362] Metadata directory not provided
23:47:37.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.365240  2925 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:37.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.365654  2925 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:37.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.368355  2925 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data/instance:
23:47:37.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b539e6213f740edbfc1f6ad8bdae0f5"
23:47:37.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:37 on dist-test-slave-hfsf"
23:47:37.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.369302  2925 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal/instance:
23:47:37.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b539e6213f740edbfc1f6ad8bdae0f5"
23:47:37.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:37 on dist-test-slave-hfsf"
23:47:37.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.375241  2925 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
23:47:37.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.379122  2939 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.380782  2925 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.381024  2925 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b539e6213f740edbfc1f6ad8bdae0f5"
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:37 on dist-test-slave-hfsf"
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.381300  2925 fs_report.cc:389] FS layout report
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data/data
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:37.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:37.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:37.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:37.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:37.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:37.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:37.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:37.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.401357  2925 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:37.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.402832  2925 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:37.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.404516  2925 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:37.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.427686  2925 rpc_server.cc:307] RPC server started. Bound to: 127.2.216.126:46485
23:47:37.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.427698  2991 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.216.126:46485 every 8 connection(s)
23:47:37.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.429476  2925 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/data/info.pb
23:47:37.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.434128  2992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:37.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.435627  2913 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2925
23:47:37.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.435971  2913 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-0/wal/instance
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.439391  2913 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:37.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/logs
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data/info.pb
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.125:34537
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.125
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:37.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36731/jwks.json with env {}
23:47:37.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.443719  2992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } has no permanent_uuid. Determining permanent_uuid...
23:47:37.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.462977  2992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } has no permanent_uuid. Determining permanent_uuid...
23:47:37.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.464201  2942 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.216.125:34537: connect: Connection refused (error 111)
23:47:37.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.465983  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.125:34537: Network error: Client connection negotiation failed: client connection to 127.2.216.125:34537: connect: Connection refused (error 111)
23:47:37.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.515393  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } attempt: 1
23:47:37.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.517640  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.125:34537: Network error: Client connection negotiation failed: client connection to 127.2.216.125:34537: connect: Connection refused (error 111)
23:47:37.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.585981  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } attempt: 2
23:47:37.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.588418  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.125:34537: Network error: Client connection negotiation failed: client connection to 127.2.216.125:34537: connect: Connection refused (error 111)
23:47:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.679775  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } attempt: 3
23:47:37.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.681981  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.125:34537: Network error: Client connection negotiation failed: client connection to 127.2.216.125:34537: connect: Connection refused (error 111)
23:47:37.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.803318  2994 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:37.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.803659  2994 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:37.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.803745  2994 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:37.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.812758  2994 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:37.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.812866  2994 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:37.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.812953  2994 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:37.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.813021  2994 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:37.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.813109  2994 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:37.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.813158  2994 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36731/jwks.json
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.823789  2994 master_runner.cc:387] Master server non-default flags:
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.125:34537
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36731/jwks.json
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data/info.pb
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.125
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/logs
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.825254  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } attempt: 4
23:47:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.825583  2994 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:37.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.827616  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.125:34537: Network error: Client connection negotiation failed: client connection to 127.2.216.125:34537: connect: Connection refused (error 111)
23:47:37.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.827842  2994 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:37.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.836741  3006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:37.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.836997  3003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:37.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.837287  3004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:37.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.837903  2994 server_base.cc:1061] running on GCE node
23:47:37.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.838747  2994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:37.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.840575  2994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:37.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.841813  2994 hybrid_clock.cc:648] HybridClock initialized: now 1783468057841732 us; error 45 us; skew 500 ppm
23:47:37.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.842155  2994 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:37.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.844833  2994 webserver.cc:534] Webserver started at http://127.2.216.125:34817/ using document root <none> and password file <none>
23:47:37.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.845575  2994 fs_manager.cc:362] Metadata directory not provided
23:47:37.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.845669  2994 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:37.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.845991  2994 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:37.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.848443  2994 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data/instance:
23:47:37.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e81ce3addf0943e3a58810c3fbac628e"
23:47:37.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:37 on dist-test-slave-hfsf"
23:47:37.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.849205  2994 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal/instance:
23:47:37.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e81ce3addf0943e3a58810c3fbac628e"
23:47:37.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:37 on dist-test-slave-hfsf"
23:47:37.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.855122  2994 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
23:47:37.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.859200  3012 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.860805  2994 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.860960  2994 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e81ce3addf0943e3a58810c3fbac628e"
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:37 on dist-test-slave-hfsf"
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.861147  2994 fs_report.cc:389] FS layout report
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data/data
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:37.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.888373  2994 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:37.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.889642  2994 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:37.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.889990  2994 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:37.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.912519  2994 rpc_server.cc:307] RPC server started. Bound to: 127.2.216.125:34537
23:47:37.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.912537  3063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.216.125:34537 every 8 connection(s)
23:47:37.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.914242  2994 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/data/info.pb
23:47:37.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.919060  3064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:37.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.921010  2913 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 2994
23:47:37.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.921171  2913 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-1/wal/instance
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.922466  2913 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/logs
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data/info.pb
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.124:33041
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.124
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36731/jwks.json with env {}
23:47:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.925972  3064 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } has no permanent_uuid. Determining permanent_uuid...
23:47:37.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.941694  3064 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } has no permanent_uuid. Determining permanent_uuid...
23:47:37.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:37.952867  3064 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } has no permanent_uuid. Determining permanent_uuid...
23:47:37.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.954306  3016 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:37.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:37.956288  3064 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.005666  3064 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 1
23:47:38.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.008100  3064 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.076387  3064 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 2
23:47:38.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.078866  3064 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.126894  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } attempt: 5
23:47:38.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.133764  2992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } has no permanent_uuid. Determining permanent_uuid...
23:47:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.135968  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.170117  3064 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 3
23:47:38.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.173007  3064 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.187232  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 1
23:47:38.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.189600  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.257851  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 2
23:47:38.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.262039  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.316256  3064 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 4
23:47:38.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.318282  3064 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.325304  3066 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:38.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.325627  3066 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:38.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.325711  3066 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:38.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.334333  3066 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:38.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.334438  3066 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:38.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.334493  3066 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:38.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.334534  3066 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:38.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.334594  3066 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:38.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.334628  3066 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36731/jwks.json
23:47:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.345553  3066 master_runner.cc:387] Master server non-default flags:
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.124:33041
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36731/jwks.json
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data/info.pb
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.124
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/logs
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:38.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:38.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.347362  3066 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:38.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.349267  3066 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:38.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.358047  3075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:38.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.358073  3074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:38.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.359017  3077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:38.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.359542  3066 server_base.cc:1061] running on GCE node
23:47:38.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.360383  3066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:38.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.362062  3066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:38.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.363462  3066 hybrid_clock.cc:648] HybridClock initialized: now 1783468058363225 us; error 63 us; skew 500 ppm
23:47:38.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.363902  3066 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.366621  3066 webserver.cc:534] Webserver started at http://127.2.216.124:40491/ using document root <none> and password file <none>
23:47:38.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.367578  3066 fs_manager.cc:362] Metadata directory not provided
23:47:38.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.367724  3066 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:38.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.368151  3066 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:38.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.368409  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 3
23:47:38.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.370395  2992 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.216.124:33041: Network error: Client connection negotiation failed: client connection to 127.2.216.124:33041: connect: Connection refused (error 111)
23:47:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.371589  3066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data/instance:
23:47:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "da4bede8a20c463592aa6147437a6012"
23:47:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:38 on dist-test-slave-hfsf"
23:47:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.372565  3066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal/instance:
23:47:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "da4bede8a20c463592aa6147437a6012"
23:47:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:38 on dist-test-slave-hfsf"
23:47:38.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.378599  3066 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:47:38.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.382593  3083 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:38.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.384199  3066 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:47:38.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.384652  3066 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "da4bede8a20c463592aa6147437a6012"
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:38 on dist-test-slave-hfsf"
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.384904  3066 fs_report.cc:389] FS layout report
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data/data
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:38.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.412211  3066 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:38.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.413225  3066 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:38.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.413563  3066 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:38.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.436949  3066 rpc_server.cc:307] RPC server started. Bound to: 127.2.216.124:33041
23:47:38.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.437094  3137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.216.124:33041 every 8 connection(s)
23:47:38.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.439457  3066 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/data/info.pb
23:47:38.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.443969  2913 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 3066
23:47:38.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.444181  2913 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/master-2/wal/instance
23:47:38.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.445127  3138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:38.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.453178  3138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } has no permanent_uuid. Determining permanent_uuid...
23:47:38.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.469033  3138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } has no permanent_uuid. Determining permanent_uuid...
23:47:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.476224  3138 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } has no permanent_uuid. Determining permanent_uuid...
23:47:38.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.488425  3138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: Bootstrap starting.
23:47:38.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.492697  3138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: Neither blocks nor log segments found. Creating new log.
23:47:38.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.494015  3138 log.cc:826] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: Log is configured to *not* fsync() on all Append() calls
23:47:38.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.497483  3138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: No bootstrap required, opened a new log
23:47:38.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.503902  3138 raft_consensus.cc:359] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.504237  3138 raft_consensus.cc:385] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:38.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.504335  3138 raft_consensus.cc:740] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da4bede8a20c463592aa6147437a6012, State: Initialized, Role: FOLLOWER
23:47:38.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.505012  3138 consensus_queue.cc:260] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.506040  3148 sys_catalog.cc:455] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.506388  3148 sys_catalog.cc:458] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.507503  3138 sys_catalog.cc:565] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: configured and running, proceeding with master startup.
23:47:38.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.516180  3066 master_runner.cc:187] Error getting master registration for 127.2.216.126:46485: OK, instance_id { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" instance_seqno: 1783468057421819 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:38.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.523582  3066 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:38.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.524674  3159 catalog_manager.cc:1593] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:38.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.524833  3159 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:38.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.547647  2992 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 4
23:47:38.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.561721  2992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: Bootstrap starting.
23:47:38.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.566910  2992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: Neither blocks nor log segments found. Creating new log.
23:47:38.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.569646  2992 log.cc:826] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: Log is configured to *not* fsync() on all Append() calls
23:47:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.573511  2992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: No bootstrap required, opened a new log
23:47:38.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.582748  2992 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.583220  2992 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:38.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.583351  2992 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b539e6213f740edbfc1f6ad8bdae0f5, State: Initialized, Role: FOLLOWER
23:47:38.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.584273  2992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.587795  3162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.588423  3162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.589294  2992 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: configured and running, proceeding with master startup.
23:47:38.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.607944  3173 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:38.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.608596  3173 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:38.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.606510  2925 master_runner.cc:187] Error getting master registration for 127.2.216.125:34537: OK, instance_id { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" instance_seqno: 1783468057906499 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:38.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.615212  2925 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:38.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.617558  3064 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } attempt: 5
23:47:38.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.631516  3064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: Bootstrap starting.
23:47:38.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.636919  3064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: Neither blocks nor log segments found. Creating new log.
23:47:38.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.638590  3064 log.cc:826] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: Log is configured to *not* fsync() on all Append() calls
23:47:38.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.642599  3064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: No bootstrap required, opened a new log
23:47:38.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.652012  3064 raft_consensus.cc:359] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.652837  3064 raft_consensus.cc:385] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:38.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.653131  3064 raft_consensus.cc:740] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81ce3addf0943e3a58810c3fbac628e, State: Initialized, Role: FOLLOWER
23:47:38.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.654167  3064 consensus_queue.cc:260] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.657338  3064 sys_catalog.cc:565] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: configured and running, proceeding with master startup.
23:47:38.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.658682  2946 tablet.cc:2406] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:38.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.661149  3162 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:38.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.661423  3162 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.663410  3162 leader_election.cc:290] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e81ce3addf0943e3a58810c3fbac628e (127.2.216.125:34537), da4bede8a20c463592aa6147437a6012 (127.2.216.124:33041)
23:47:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.665154  3112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da4bede8a20c463592aa6147437a6012" is_pre_election: true
23:47:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.665947  3112 raft_consensus.cc:2468] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b539e6213f740edbfc1f6ad8bdae0f5 in term 0.
23:47:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:38.666179  3089 tablet.cc:2406] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:38.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.668766  2943 leader_election.cc:304] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b539e6213f740edbfc1f6ad8bdae0f5, da4bede8a20c463592aa6147437a6012; no voters: 
23:47:38.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.670734  3039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81ce3addf0943e3a58810c3fbac628e" is_pre_election: true
23:47:38.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.671357  3039 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b539e6213f740edbfc1f6ad8bdae0f5 in term 0.
23:47:38.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.673120  3162 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:38.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.673307  3162 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:38.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.673413  3162 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 0 FOLLOWER]: Advancing to term 1
23:47:38.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.677436  3162 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.679019  3039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e81ce3addf0943e3a58810c3fbac628e"
23:47:38.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.679252  3039 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 0 FOLLOWER]: Advancing to term 1
23:47:38.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.688711  3039 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b539e6213f740edbfc1f6ad8bdae0f5 in term 1.
23:47:38.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.689563  2942 leader_election.cc:304] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b539e6213f740edbfc1f6ad8bdae0f5, e81ce3addf0943e3a58810c3fbac628e; no voters: 
23:47:38.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.693163  3112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da4bede8a20c463592aa6147437a6012"
23:47:38.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.693429  3112 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 0 FOLLOWER]: Advancing to term 1
23:47:38.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.695307  3182 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 1 FOLLOWER]: Leader election won for term 1
23:47:38.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.697526  3112 raft_consensus.cc:2468] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b539e6213f740edbfc1f6ad8bdae0f5 in term 1.
23:47:38.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.698566  3162 leader_election.cc:290] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [CANDIDATE]: Term 1 election: Requested vote from peers e81ce3addf0943e3a58810c3fbac628e (127.2.216.125:34537), da4bede8a20c463592aa6147437a6012 (127.2.216.124:33041)
23:47:38.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.699697  3176 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.700389  3176 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.701233  3182 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 0b539e6213f740edbfc1f6ad8bdae0f5, State: Running, Role: LEADER
23:47:38.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.702189  3182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } }
23:47:38.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.718297  3162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b539e6213f740edbfc1f6ad8bdae0f5. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.718717  3162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: This master's current role is: LEADER
23:47:38.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.721361  3191 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:47:38.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.721313  3190 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
23:47:38.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.724308  3191 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:47:38.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.739517  3112 raft_consensus.cc:1275] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [term 1 FOLLOWER]: Refusing update from remote peer 0b539e6213f740edbfc1f6ad8bdae0f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:38.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.741186  3162 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:38.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.742166  3039 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [term 1 FOLLOWER]: Refusing update from remote peer 0b539e6213f740edbfc1f6ad8bdae0f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:38.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.743515  3162 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:38.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.767817  3176 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b539e6213f740edbfc1f6ad8bdae0f5. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.768117  3176 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.771806  3192 mvcc.cc:204] Tried to move back new op lower bound from 7305085168584679424 to 7305085168451018752. Current Snapshot: MvccSnapshot[applied={T|T < 7305085168584679424}]
23:47:38.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.773137  3194 mvcc.cc:204] Tried to move back new op lower bound from 7305085168584679424 to 7305085168451018752. Current Snapshot: MvccSnapshot[applied={T|T < 7305085168584679424}]
23:47:38.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.778479  3148 sys_catalog.cc:455] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b539e6213f740edbfc1f6ad8bdae0f5. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.778797  3148 sys_catalog.cc:458] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.785322  3148 sys_catalog.cc:455] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.785535  3148 sys_catalog.cc:458] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012 [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.786566  3193 mvcc.cc:204] Tried to move back new op lower bound from 7305085168584679424 to 7305085168451018752. Current Snapshot: MvccSnapshot[applied={T|T < 7305085168584679424}]
23:47:38.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.787438  3185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.787756  3185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: This master's current role is: LEADER
23:47:38.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.788297  3185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.788483  3185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5 [sys.catalog]: This master's current role is: LEADER
23:47:38.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.788658  3191 catalog_manager.cc:1382] Generated new cluster ID: 0079d777efda4064b49a1b23ac44b750
23:47:38.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.788776  3191 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:47:38.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.789323  3176 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b539e6213f740edbfc1f6ad8bdae0f5" member_type: VOTER last_known_addr { host: "127.2.216.126" port: 46485 } } peers { permanent_uuid: "e81ce3addf0943e3a58810c3fbac628e" member_type: VOTER last_known_addr { host: "127.2.216.125" port: 34537 } } peers { permanent_uuid: "da4bede8a20c463592aa6147437a6012" member_type: VOTER last_known_addr { host: "127.2.216.124" port: 33041 } } }
23:47:38.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.789536  3176 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e [sys.catalog]: This master's current role is: FOLLOWER
23:47:38.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.820992  3191 catalog_manager.cc:1405] Generated new certificate authority record
23:47:38.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.823359  3191 catalog_manager.cc:1539] Loading token signing keys...
23:47:38.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.844569  3191 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: Generated new TSK 0
23:47:38.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.846261  3191 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:38.859182  2913 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/logs
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data/info.pb
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.65:0
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.216.65
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.65
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:39.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.325911  3200 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:39.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.326272  3200 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:39.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.326372  3200 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:39.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.336032  3200 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:39.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.336225  3200 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.216.65
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.348889  3200 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.65:0
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data/info.pb
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.65
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.216.65
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/logs
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:39.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:39.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:39.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:39.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:39.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.350694  3200 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:39.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.352977  3200 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:39.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.366209  3209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:39.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.366160  3207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:39.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.366115  3206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.367137  3200 server_base.cc:1061] running on GCE node
23:47:39.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.367899  3200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:39.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.368956  3200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:39.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.370229  3200 hybrid_clock.cc:648] HybridClock initialized: now 1783468059370153 us; error 62 us; skew 500 ppm
23:47:39.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.370694  3200 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:39.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.373358  3200 webserver.cc:534] Webserver started at http://127.2.216.65:44659/ using document root <none> and password file <none>
23:47:39.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.374292  3200 fs_manager.cc:362] Metadata directory not provided
23:47:39.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.374435  3200 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:39.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.374895  3200 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:39.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.377722  3200 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data/instance:
23:47:39.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2497782e9f38423697f3ef19daca47ce"
23:47:39.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:39 on dist-test-slave-hfsf"
23:47:39.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.378633  3200 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal/instance:
23:47:39.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2497782e9f38423697f3ef19daca47ce"
23:47:39.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:39 on dist-test-slave-hfsf"
23:47:39.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.384828  3200 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.000s
23:47:39.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.389055  3215 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:39.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.390693  3200 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.391068  3200 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2497782e9f38423697f3ef19daca47ce"
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:39 on dist-test-slave-hfsf"
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.391299  3200 fs_report.cc:389] FS layout report
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data/data
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:39.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:39.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:39.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:39.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.412985  3200 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:39.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.414058  3200 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:39.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.414402  3200 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:39.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.415812  3200 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:39.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.417945  3200 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:39.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.418078  3200 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:39.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.418190  3200 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:39.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.418267  3200 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:39.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.470328  3200 rpc_server.cc:307] RPC server started. Bound to: 127.2.216.65:34053
23:47:39.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.470376  3328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.216.65:34053 every 8 connection(s)
23:47:39.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.472023  3200 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/data/info.pb
23:47:39.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.475157  2913 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 3200
23:47:39.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.475359  2913 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-0/wal/instance
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.481264  2913 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/logs
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data/info.pb
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.66:0
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.216.66
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.66
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:39.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:39.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:39.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.494395  3330 heartbeater.cc:344] Connected to a master server at 127.2.216.126:46485
23:47:39.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.494931  3330 heartbeater.cc:461] Registering TS with master...
23:47:39.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.496342  3330 heartbeater.cc:507] Master 127.2.216.126:46485 requested a full tablet report, sending...
23:47:39.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.498692  3331 heartbeater.cc:344] Connected to a master server at 127.2.216.125:34537
23:47:39.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.498886  3331 heartbeater.cc:461] Registering TS with master...
23:47:39.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.499178  2957 ts_manager.cc:194] Registered new tserver with Master: 2497782e9f38423697f3ef19daca47ce (127.2.216.65:34053)
23:47:39.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.499404  3331 heartbeater.cc:507] Master 127.2.216.125:34537 requested a full tablet report, sending...
23:47:39.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.499755  3329 heartbeater.cc:344] Connected to a master server at 127.2.216.124:33041
23:47:39.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.499884  3329 heartbeater.cc:461] Registering TS with master...
23:47:39.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.500388  3329 heartbeater.cc:507] Master 127.2.216.124:33041 requested a full tablet report, sending...
23:47:39.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.501222  3029 ts_manager.cc:194] Registered new tserver with Master: 2497782e9f38423697f3ef19daca47ce (127.2.216.65:34053)
23:47:39.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.501408  2957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.216.65:58987
23:47:39.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.502458  3101 ts_manager.cc:194] Registered new tserver with Master: 2497782e9f38423697f3ef19daca47ce (127.2.216.65:34053)
23:47:39.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.526685  3159 catalog_manager.cc:1294] Loaded cluster ID: 0079d777efda4064b49a1b23ac44b750
23:47:39.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.526818  3159 catalog_manager.cc:1587] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: loading cluster ID for follower catalog manager: success
23:47:39.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.529604  3159 catalog_manager.cc:1609] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: acquiring CA information for follower catalog manager: success
23:47:39.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.531513  3159 catalog_manager.cc:1637] T 00000000000000000000000000000000 P da4bede8a20c463592aa6147437a6012: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:39.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.727993  3190 catalog_manager.cc:1294] Loaded cluster ID: 0079d777efda4064b49a1b23ac44b750
23:47:39.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.728145  3190 catalog_manager.cc:1587] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: loading cluster ID for follower catalog manager: success
23:47:39.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.732367  3190 catalog_manager.cc:1609] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: acquiring CA information for follower catalog manager: success
23:47:39.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.735383  3190 catalog_manager.cc:1637] T 00000000000000000000000000000000 P e81ce3addf0943e3a58810c3fbac628e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:39.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.860294  3339 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:39.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.860698  3339 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:39.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.860847  3339 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.869740  3339 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.869915  3339 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.216.66
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.882905  3339 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.66:0
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data/info.pb
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.66
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:39.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.216.66
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/logs
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:39.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.887256  3339 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:39.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.891368  3339 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:39.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.903129  3346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:39.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.903195  3345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:39.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:39.905025  3348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:39.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.905649  3339 server_base.cc:1061] running on GCE node
23:47:39.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.906258  3339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:39.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.907377  3339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.908613  3339 hybrid_clock.cc:648] HybridClock initialized: now 1783468059908559 us; error 48 us; skew 500 ppm
23:47:39.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.909080  3339 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:39.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.911837  3339 webserver.cc:534] Webserver started at http://127.2.216.66:45511/ using document root <none> and password file <none>
23:47:39.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.912854  3339 fs_manager.cc:362] Metadata directory not provided
23:47:39.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.912998  3339 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:39.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.913375  3339 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:39.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.916720  3339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data/instance:
23:47:39.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1454f92b93f44b289278eda793906c7e"
23:47:39.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:39 on dist-test-slave-hfsf"
23:47:39.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.918041  3339 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal/instance:
23:47:39.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1454f92b93f44b289278eda793906c7e"
23:47:39.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:39 on dist-test-slave-hfsf"
23:47:39.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.933378  3339 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.002s	sys 0.011s
23:47:39.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.937714  3354 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.939786  3339 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.940040  3339 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1454f92b93f44b289278eda793906c7e"
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:39 on dist-test-slave-hfsf"
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.940352  3339 fs_report.cc:389] FS layout report
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data/data
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:39.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:39.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:39.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.965838  3339 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:39.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.967103  3339 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:39.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.967438  3339 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:39.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.968638  3339 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:39.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.970536  3339 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:39.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.970664  3339 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:39.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.970783  3339 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:39.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:39.970882  3339 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
23:47:40.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.021476  3339 rpc_server.cc:307] RPC server started. Bound to: 127.2.216.66:42211
23:47:40.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.021500  3470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.216.66:42211 every 8 connection(s)
23:47:40.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.024835  3339 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/data/info.pb
23:47:40.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.027434  2913 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 3339
23:47:40.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.027628  2913 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-1/wal/instance
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.033473  2913 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/logs
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data/info.pb
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:40.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.67:0
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.216.67
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.67
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:40.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:40.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.068965  3472 heartbeater.cc:344] Connected to a master server at 127.2.216.126:46485
23:47:40.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.069049  3471 heartbeater.cc:344] Connected to a master server at 127.2.216.124:33041
23:47:40.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.069383  3472 heartbeater.cc:461] Registering TS with master...
23:47:40.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.069389  3471 heartbeater.cc:461] Registering TS with master...
23:47:40.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.070609  3472 heartbeater.cc:507] Master 127.2.216.126:46485 requested a full tablet report, sending...
23:47:40.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.070642  3471 heartbeater.cc:507] Master 127.2.216.124:33041 requested a full tablet report, sending...
23:47:40.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.072736  2957 ts_manager.cc:194] Registered new tserver with Master: 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211)
23:47:40.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.073179  3101 ts_manager.cc:194] Registered new tserver with Master: 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211)
23:47:40.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.073890  2957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.216.66:48783
23:47:40.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.077562  3477 heartbeater.cc:344] Connected to a master server at 127.2.216.125:34537
23:47:40.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.077734  3477 heartbeater.cc:461] Registering TS with master...
23:47:40.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.078154  3477 heartbeater.cc:507] Master 127.2.216.125:34537 requested a full tablet report, sending...
23:47:40.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.079887  3029 ts_manager.cc:194] Registered new tserver with Master: 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211)
23:47:40.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.466070  3478 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:40.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.466487  3478 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:40.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.466612  3478 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:40.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.479544  3478 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:40.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.479805  3478 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.216.67
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.493038  3478 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.216.84:39585
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:40.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.216.67:0
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data/info.pb
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.216.67
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.216.126:46485,127.2.216.125:34537,127.2.216.124:33041
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.216.67
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/logs
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:40.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:40.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:40.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.495540  3478 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:40.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.497766  3478 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:40.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.504158  3330 heartbeater.cc:499] Master 127.2.216.126:46485 was elected leader, sending a full tablet report...
23:47:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.510608  3488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.510921  3487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:40.510967  3490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:40.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.512241  3478 server_base.cc:1061] running on GCE node
23:47:40.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.512923  3478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:40.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.513934  3478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:40.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.515144  3478 hybrid_clock.cc:648] HybridClock initialized: now 1783468060515098 us; error 38 us; skew 500 ppm
23:47:40.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.515460  3478 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:40.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.518298  3478 webserver.cc:534] Webserver started at http://127.2.216.67:33349/ using document root <none> and password file <none>
23:47:40.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.519169  3478 fs_manager.cc:362] Metadata directory not provided
23:47:40.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.519274  3478 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:40.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.519583  3478 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:40.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.522279  3478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data/instance:
23:47:40.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "071123ab2a624943b6d34ad7c2772e4e"
23:47:40.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:40 on dist-test-slave-hfsf"
23:47:40.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.523202  3478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal/instance:
23:47:40.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "071123ab2a624943b6d34ad7c2772e4e"
23:47:40.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:40 on dist-test-slave-hfsf"
23:47:40.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.529151  3478 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:47:40.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.533592  3496 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:40.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.535573  3478 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
23:47:40.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.535741  3478 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal
23:47:40.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "071123ab2a624943b6d34ad7c2772e4e"
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:40 on dist-test-slave-hfsf"
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.535933  3478 fs_report.cc:389] FS layout report
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data/data
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:40.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.566659  3478 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:40.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.568011  3478 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:40.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.568270  3478 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:40.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.569260  3478 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:40.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.571247  3478 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:40.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.571354  3478 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:40.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.571430  3478 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:40.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.571476  3478 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:40.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.615437  3478 rpc_server.cc:307] RPC server started. Bound to: 127.2.216.67:36231
23:47:40.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.615487  3611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.216.67:36231 every 8 connection(s)
23:47:40.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.617786  3478 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/data/info.pb
23:47:40.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.619976  2913 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 3478
23:47:40.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.620133  2913 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster9408975344752336215/ts-2/wal/instance
23:47:40.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.680323  3614 heartbeater.cc:344] Connected to a master server at 127.2.216.125:34537
23:47:40.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.680840  3614 heartbeater.cc:461] Registering TS with master...
23:47:40.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.681945  3613 heartbeater.cc:344] Connected to a master server at 127.2.216.126:46485
23:47:40.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.682142  3613 heartbeater.cc:461] Registering TS with master...
23:47:40.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.682309  3614 heartbeater.cc:507] Master 127.2.216.125:34537 requested a full tablet report, sending...
23:47:40.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.682687  3613 heartbeater.cc:507] Master 127.2.216.126:46485 requested a full tablet report, sending...
23:47:40.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.683702  3612 heartbeater.cc:344] Connected to a master server at 127.2.216.124:33041
23:47:40.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.683848  3612 heartbeater.cc:461] Registering TS with master...
23:47:40.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.684183  2957 ts_manager.cc:194] Registered new tserver with Master: 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:40.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.684363  3612 heartbeater.cc:507] Master 127.2.216.124:33041 requested a full tablet report, sending...
23:47:40.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.684433  3029 ts_manager.cc:194] Registered new tserver with Master: 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:40.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.685096  2957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.216.67:57175
23:47:40.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.685866  3101 ts_manager.cc:194] Registered new tserver with Master: 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:40.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:40.693096  2913 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:47:40.695 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:40.695 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:47:40.699 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.216.126"
      port: 46485
    }
    bound_http_address {
      host: "127.2.216.126"
      port: 34281
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.216.125"
      port: 34537
    }
    bound_http_address {
      host: "127.2.216.125"
      port: 34817
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.216.124"
      port: 33041
    }
    bound_http_address {
      host: "127.2.216.124"
      port: 40491
    }
  }
}

23:47:40.700 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:47:40.701 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.216.65"
      port: 34053
    }
    bound_http_address {
      host: "127.2.216.65"
      port: 44659
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.216.66"
      port: 42211
    }
    bound_http_address {
      host: "127.2.216.66"
      port: 45511
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.216.67"
      port: 36231
    }
    bound_http_address {
      host: "127.2.216.67"
      port: 33349
    }
  }
}

23:47:40.701 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:47:40.704 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:40.782 [DEBUG - main] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:40.793 [DEBUG - main] (DefaultChannelId.java:84) -Dio.netty.processId: 2191 (auto-detected)
23:47:40.795 [DEBUG - main] (NetUtil.java:149) -Djava.net.preferIPv4Stack: true
23:47:40.795 [DEBUG - main] (NetUtil.java:150) -Djava.net.preferIPv6Addresses: false
23:47:40.797 [DEBUG - main] (NetUtilInitializations.java:145) Loopback interface: lo (lo, 127.0.0.1)
23:47:40.798 [DEBUG - main] (NetUtil.java:198) /proc/sys/net/core/somaxconn: 4096
23:47:40.800 [DEBUG - main] (DefaultChannelId.java:106) -Dio.netty.machineId: 02:42:6f:ff:fe:6c:79:94 (auto-detected)
23:47:40.827 [DEBUG - main] (ByteBufUtil.java:89) -Dio.netty.allocator.type: pooled
23:47:40.827 [DEBUG - main] (ByteBufUtil.java:101) -Dio.netty.threadLocalDirectBufferSize: 0
23:47:40.827 [DEBUG - main] (ByteBufUtil.java:104) -Dio.netty.maxThreadLocalCharBufferSize: 16384
23:47:40.835 [DEBUG - main] (ChannelInitializerExtensions.java:54) -Dio.netty.bootstrap.extensions: null
23:47:40.841 [DEBUG - main] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:40.842 [DEBUG - main] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:40.862 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.42.124:36407(127.2.42.124:36407)] Successfully connected to peer
23:47:40.865 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.42.126:45489(127.2.42.126:45489)] Successfully connected to peer
23:47:40.866 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.42.125:42983(127.2.42.125:42983)] Successfully connected to peer
23:47:40.894 [DEBUG - kudu-nio-1] (AbstractByteBuf.java:63) -Dorg.apache.kudu.shaded.io.netty.buffer.checkAccessible: true
23:47:40.895 [DEBUG - kudu-nio-1] (AbstractByteBuf.java:64) -Dorg.apache.kudu.shaded.io.netty.buffer.checkBounds: true
23:47:40.895 [DEBUG - kudu-nio-1] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@e83e10b
23:47:40.903 [DEBUG - kudu-nio-1] (Recycler.java:96) -Dio.netty.recycler.maxCapacityPerThread: 4096
23:47:40.903 [DEBUG - kudu-nio-1] (Recycler.java:97) -Dio.netty.recycler.ratio: 8
23:47:40.903 [DEBUG - kudu-nio-1] (Recycler.java:98) -Dio.netty.recycler.chunkSize: 32
23:47:40.903 [DEBUG - kudu-nio-1] (Recycler.java:99) -Dio.netty.recycler.blocking: false
23:47:40.903 [DEBUG - kudu-nio-1] (Recycler.java:100) -Dio.netty.recycler.batchFastThreadLocalOnly: true
23:47:40.981 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.126
23:47:40.981 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.125
23:47:40.981 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.124
23:47:41.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.076838  3472 heartbeater.cc:499] Master 127.2.216.126:46485 was elected leader, sending a full tablet report...
23:47:41.188 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:41.188 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:41.196 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:41.219 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbeef80ac, L:/127.0.0.1:34960 - R:/127.2.42.126:45489] using SASL/PLAIN
23:47:41.219 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbe47bdb5, L:/127.0.0.1:37376 - R:/127.2.42.125:42983] using SASL/PLAIN
23:47:41.219 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc26117f6, L:/127.0.0.1:42862 - R:/127.2.42.124:36407] using SASL/PLAIN
23:47:41.257 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:41.258 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=515), Traces: [0ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [488ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: OK, [488ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: OK, [489ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, deferred=null) after lookup
23:47:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.309959  2404 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42862:
23:47:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:47:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:47:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:47:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000\006\001d\000\000\000\007\001\310\000\000\000"
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:47:41.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:41.313263  2404 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:47:41.374 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.384243  2835 tablet_service.cc:1511] Processing CreateTablet for tablet 37568e9b29014c3e9276b04109023ab5 (DEFAULT_TABLE table=replication_test_table [id=d39e0482339b468e842599b2c1b07a37]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.384575  2700 tablet_service.cc:1511] Processing CreateTablet for tablet 37568e9b29014c3e9276b04109023ab5 (DEFAULT_TABLE table=replication_test_table [id=d39e0482339b468e842599b2c1b07a37]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.386479  2835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37568e9b29014c3e9276b04109023ab5. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.387003  2836 tablet_service.cc:1511] Processing CreateTablet for tablet 84f439a803514545aa7850275652b318 (DEFAULT_TABLE table=replication_test_table [id=d39e0482339b468e842599b2c1b07a37]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.387132  2701 tablet_service.cc:1511] Processing CreateTablet for tablet 84f439a803514545aa7850275652b318 (DEFAULT_TABLE table=replication_test_table [id=d39e0482339b468e842599b2c1b07a37]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.387620  2836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f439a803514545aa7850275652b318. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.388399  2700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37568e9b29014c3e9276b04109023ab5. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:41.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.389006  2701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f439a803514545aa7850275652b318. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:41.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.405580  2562 tablet_service.cc:1511] Processing CreateTablet for tablet 37568e9b29014c3e9276b04109023ab5 (DEFAULT_TABLE table=replication_test_table [id=d39e0482339b468e842599b2c1b07a37]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:47:41.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.407167  2563 tablet_service.cc:1511] Processing CreateTablet for tablet 84f439a803514545aa7850275652b318 (DEFAULT_TABLE table=replication_test_table [id=d39e0482339b468e842599b2c1b07a37]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
23:47:41.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.408362  2563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f439a803514545aa7850275652b318. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:41.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.413232  2562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37568e9b29014c3e9276b04109023ab5. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:41.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.416041  3646 tablet_bootstrap.cc:492] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5: Bootstrap starting.
23:47:41.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.418720  3647 tablet_bootstrap.cc:492] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: Bootstrap starting.
23:47:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.423754  3646 tablet_bootstrap.cc:654] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5: Neither blocks nor log segments found. Creating new log.
23:47:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.423769  3647 tablet_bootstrap.cc:654] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: Neither blocks nor log segments found. Creating new log.
23:47:41.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.425201  3647 log.cc:826] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: Log is configured to *not* fsync() on all Append() calls
23:47:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.426524  3646 log.cc:826] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5: Log is configured to *not* fsync() on all Append() calls
23:47:41.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.449631  3647 tablet_bootstrap.cc:492] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: No bootstrap required, opened a new log
23:47:41.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.450507  3647 ts_tablet_manager.cc:1403] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
23:47:41.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.451336  3650 tablet_bootstrap.cc:492] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: Bootstrap starting.
23:47:41.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.452795  3646 tablet_bootstrap.cc:492] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5: No bootstrap required, opened a new log
23:47:41.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.453140  3646 ts_tablet_manager.cc:1403] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.023s
23:47:41.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.456063  3650 tablet_bootstrap.cc:654] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: Neither blocks nor log segments found. Creating new log.
23:47:41.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.457592  3650 log.cc:826] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: Log is configured to *not* fsync() on all Append() calls
23:47:41.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.459378  3646 raft_consensus.cc:359] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.459542  3647 raft_consensus.cc:359] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.459836  3647 raft_consensus.cc:385] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.459913  3647 raft_consensus.cc:740] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b12f0866b0104f9ebf76bdc0cd56d7e9, State: Initialized, Role: FOLLOWER
23:47:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.460268  3646 raft_consensus.cc:385] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.460536  3646 raft_consensus.cc:740] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a910d7b024e4df2993580f4f2923bb5, State: Initialized, Role: FOLLOWER
23:47:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.460556  3647 consensus_queue.cc:260] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.461336  3650 tablet_bootstrap.cc:492] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: No bootstrap required, opened a new log
23:47:41.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.461489  3646 consensus_queue.cc:260] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.465109  3650 ts_tablet_manager.cc:1403] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
23:47:41.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.468889  3647 ts_tablet_manager.cc:1434] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
23:47:41.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.469823  3647 tablet_bootstrap.cc:492] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9: Bootstrap starting.
23:47:41.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.473704  3646 ts_tablet_manager.cc:1434] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.004s
23:47:41.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.474268  3647 tablet_bootstrap.cc:654] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9: Neither blocks nor log segments found. Creating new log.
23:47:41.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.474448  3646 tablet_bootstrap.cc:492] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5: Bootstrap starting.
23:47:41.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.476601  3646 tablet_bootstrap.cc:654] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5: Neither blocks nor log segments found. Creating new log.
23:47:41.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.484097  3650 raft_consensus.cc:359] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.484921  3650 raft_consensus.cc:385] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:41.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.487308  3650 raft_consensus.cc:740] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5166c0ced7204d998d8062d51526bfbd, State: Initialized, Role: FOLLOWER
23:47:41.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.488545  3650 consensus_queue.cc:260] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.495381  3647 tablet_bootstrap.cc:492] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9: No bootstrap required, opened a new log
23:47:41.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.495935  3646 tablet_bootstrap.cc:492] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5: No bootstrap required, opened a new log
23:47:41.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.496126  3646 ts_tablet_manager.cc:1403] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.006s
23:47:41.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.496306  3647 ts_tablet_manager.cc:1403] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.009s
23:47:41.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.497314  3646 raft_consensus.cc:359] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.497624  3646 raft_consensus.cc:385] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:41.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.497731  3646 raft_consensus.cc:740] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a910d7b024e4df2993580f4f2923bb5, State: Initialized, Role: FOLLOWER
23:47:41.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.498018  3646 consensus_queue.cc:260] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.498878  3647 raft_consensus.cc:359] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.499411  3647 raft_consensus.cc:385] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:41.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.499694  3647 raft_consensus.cc:740] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b12f0866b0104f9ebf76bdc0cd56d7e9, State: Initialized, Role: FOLLOWER
23:47:41.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.500248  3647 consensus_queue.cc:260] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.502414  3647 ts_tablet_manager.cc:1434] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
23:47:41.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.506299  3646 ts_tablet_manager.cc:1434] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.002s
23:47:41.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.515463  3650 ts_tablet_manager.cc:1434] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: Time spent starting tablet: real 0.050s	user 0.015s	sys 0.013s
23:47:41.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.516074  3650 tablet_bootstrap.cc:492] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd: Bootstrap starting.
23:47:41.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.519361  3650 tablet_bootstrap.cc:654] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd: Neither blocks nor log segments found. Creating new log.
23:47:41.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.521466  3650 tablet_bootstrap.cc:492] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd: No bootstrap required, opened a new log
23:47:41.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.521626  3650 ts_tablet_manager.cc:1403] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
23:47:41.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.522738  3650 raft_consensus.cc:359] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.523281  3650 raft_consensus.cc:385] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:41.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.523269  3654 raft_consensus.cc:493] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:41.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.523414  3650 raft_consensus.cc:740] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5166c0ced7204d998d8062d51526bfbd, State: Initialized, Role: FOLLOWER
23:47:41.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.523555  3654 raft_consensus.cc:515] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.523736  3650 consensus_queue.cc:260] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.524343  3650 ts_tablet_manager.cc:1434] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:47:41.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.526322  3654 leader_election.cc:290] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5166c0ced7204d998d8062d51526bfbd (127.2.42.65:39257), b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741)
23:47:41.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.539279  2583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f439a803514545aa7850275652b318" candidate_uuid: "7a910d7b024e4df2993580f4f2923bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5166c0ced7204d998d8062d51526bfbd" is_pre_election: true
23:47:41.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.540007  2583 raft_consensus.cc:2468] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a910d7b024e4df2993580f4f2923bb5 in term 0.
23:47:41.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.539990  2721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f439a803514545aa7850275652b318" candidate_uuid: "7a910d7b024e4df2993580f4f2923bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" is_pre_election: true
23:47:41.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.540463  2721 raft_consensus.cc:2468] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a910d7b024e4df2993580f4f2923bb5 in term 0.
23:47:41.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.541133  2788 leader_election.cc:304] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5166c0ced7204d998d8062d51526bfbd, 7a910d7b024e4df2993580f4f2923bb5, b12f0866b0104f9ebf76bdc0cd56d7e9; no voters: 
23:47:41.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.541671  3654 raft_consensus.cc:2804] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:41.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.541868  3654 raft_consensus.cc:493] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:41.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.541976  3654 raft_consensus.cc:3060] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Advancing to term 1
23:47:41.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.544739  3654 raft_consensus.cc:515] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.545521  3654 leader_election.cc:290] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 5166c0ced7204d998d8062d51526bfbd (127.2.42.65:39257), b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741)
23:47:41.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.546139  2583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f439a803514545aa7850275652b318" candidate_uuid: "7a910d7b024e4df2993580f4f2923bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5166c0ced7204d998d8062d51526bfbd"
23:47:41.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.546185  2721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f439a803514545aa7850275652b318" candidate_uuid: "7a910d7b024e4df2993580f4f2923bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9"
23:47:41.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.546401  2583 raft_consensus.cc:3060] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Advancing to term 1
23:47:41.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.546401  2721 raft_consensus.cc:3060] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Advancing to term 1
23:47:41.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.550951  2721 raft_consensus.cc:2468] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a910d7b024e4df2993580f4f2923bb5 in term 1.
23:47:41.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.550953  2583 raft_consensus.cc:2468] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a910d7b024e4df2993580f4f2923bb5 in term 1.
23:47:41.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.551524  2788 leader_election.cc:304] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a910d7b024e4df2993580f4f2923bb5, b12f0866b0104f9ebf76bdc0cd56d7e9; no voters: 
23:47:41.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.551986  3654 raft_consensus.cc:2804] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 1 FOLLOWER]: Leader election won for term 1
23:47:41.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.552610  3654 raft_consensus.cc:697] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7a910d7b024e4df2993580f4f2923bb5, State: Running, Role: LEADER
23:47:41.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.553200  3654 consensus_queue.cc:237] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } }
23:47:41.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.560786  2403 catalog_manager.cc:5696] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a910d7b024e4df2993580f4f2923bb5 (127.2.42.67). New cstate: current_term: 1 leader_uuid: "7a910d7b024e4df2993580f4f2923bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } health_report { overall_health: UNKNOWN } } }
23:47:41.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.561918  3657 raft_consensus.cc:493] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:41.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.562112  3657 raft_consensus.cc:515] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.566572  3657 leader_election.cc:290] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741), 7a910d7b024e4df2993580f4f2923bb5 (127.2.42.67:34367)
23:47:41.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.577888  2721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37568e9b29014c3e9276b04109023ab5" candidate_uuid: "5166c0ced7204d998d8062d51526bfbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" is_pre_election: true
23:47:41.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.578230  2721 raft_consensus.cc:2468] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5166c0ced7204d998d8062d51526bfbd in term 0.
23:47:41.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.578522  2857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37568e9b29014c3e9276b04109023ab5" candidate_uuid: "5166c0ced7204d998d8062d51526bfbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a910d7b024e4df2993580f4f2923bb5" is_pre_election: true
23:47:41.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.578872  2515 leader_election.cc:304] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5166c0ced7204d998d8062d51526bfbd, b12f0866b0104f9ebf76bdc0cd56d7e9; no voters: 
23:47:41.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.579026  2857 raft_consensus.cc:2468] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5166c0ced7204d998d8062d51526bfbd in term 0.
23:47:41.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.579310  3657 raft_consensus.cc:2804] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:41.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.579458  3657 raft_consensus.cc:493] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:41.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.579576  3657 raft_consensus.cc:3060] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 0 FOLLOWER]: Advancing to term 1
23:47:41.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.582361  3657 raft_consensus.cc:515] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.583228  3657 leader_election.cc:290] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [CANDIDATE]: Term 1 election: Requested vote from peers b12f0866b0104f9ebf76bdc0cd56d7e9 (127.2.42.66:39741), 7a910d7b024e4df2993580f4f2923bb5 (127.2.42.67:34367)
23:47:41.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.583678  2721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37568e9b29014c3e9276b04109023ab5" candidate_uuid: "5166c0ced7204d998d8062d51526bfbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9"
23:47:41.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.583838  2857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37568e9b29014c3e9276b04109023ab5" candidate_uuid: "5166c0ced7204d998d8062d51526bfbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a910d7b024e4df2993580f4f2923bb5"
23:47:41.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.583942  2721 raft_consensus.cc:3060] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 0 FOLLOWER]: Advancing to term 1
23:47:41.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.584054  2857 raft_consensus.cc:3060] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 0 FOLLOWER]: Advancing to term 1
23:47:41.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.586016  2721 raft_consensus.cc:2468] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5166c0ced7204d998d8062d51526bfbd in term 1.
23:47:41.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.586488  2515 leader_election.cc:304] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5166c0ced7204d998d8062d51526bfbd, b12f0866b0104f9ebf76bdc0cd56d7e9; no voters: 
23:47:41.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.586894  3657 raft_consensus.cc:2804] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 1 FOLLOWER]: Leader election won for term 1
23:47:41.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.586862  2857 raft_consensus.cc:2468] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5166c0ced7204d998d8062d51526bfbd in term 1.
23:47:41.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.587605  3657 raft_consensus.cc:697] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [term 1 LEADER]: Becoming Leader. State: Replica: 5166c0ced7204d998d8062d51526bfbd, State: Running, Role: LEADER
23:47:41.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.588438  3657 consensus_queue.cc:237] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } }
23:47:41.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:41.589636  2631 tablet.cc:2406] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:41.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.594667  2403 catalog_manager.cc:5696] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd reported cstate change: term changed from 0 to 1, leader changed from <none> to 5166c0ced7204d998d8062d51526bfbd (127.2.42.65). New cstate: current_term: 1 leader_uuid: "5166c0ced7204d998d8062d51526bfbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 } health_report { overall_health: UNKNOWN } } }
23:47:41.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:41.604938  2769 tablet.cc:2406] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:41.631 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:41.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:41.631753  2905 tablet.cc:2406] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:41.656 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:41.656 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:41.658 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998}]
23:47:41.659 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=19), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [10ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, deferred=null) after lookup
23:47:41.667 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:41.670 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] Successfully connected to peer
23:47:41.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.688340  3613 heartbeater.cc:499] Master 127.2.216.126:46485 was elected leader, sending a full tablet report...
23:47:41.734 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:41.740 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x65b67f75, L:/127.0.0.1:39368 - R:/127.2.42.67:34367] using TOKEN/null
23:47:41.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.750160  2583 raft_consensus.cc:1275] T 84f439a803514545aa7850275652b318 P 5166c0ced7204d998d8062d51526bfbd [term 1 FOLLOWER]: Refusing update from remote peer 7a910d7b024e4df2993580f4f2923bb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:41.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.750293  2721 raft_consensus.cc:1275] T 84f439a803514545aa7850275652b318 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 1 FOLLOWER]: Refusing update from remote peer 7a910d7b024e4df2993580f4f2923bb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:41.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.751379  3661 consensus_queue.cc:1048] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:41.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.751693  3654 consensus_queue.cc:1048] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5166c0ced7204d998d8062d51526bfbd" member_type: VOTER last_known_addr { host: "127.2.42.65" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:41.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.766103  3668 mvcc.cc:204] Tried to move back new op lower bound from 7305085180917760000 to 7305085180129177600. Current Snapshot: MvccSnapshot[applied={T|T < 7305085180917760000}]
23:47:41.838 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:41.839 [DEBUG - main] (Connection.java:748) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] connecting to peer
23:47:41.841 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] Successfully connected to peer
23:47:41.869 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:41.874 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xccf37493, L:/127.0.0.1:33730 - R:/127.2.42.65:39257] using TOKEN/null
23:47:41.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.879534  2721 raft_consensus.cc:1275] T 37568e9b29014c3e9276b04109023ab5 P b12f0866b0104f9ebf76bdc0cd56d7e9 [term 1 FOLLOWER]: Refusing update from remote peer 5166c0ced7204d998d8062d51526bfbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:41.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.879946  2857 raft_consensus.cc:1275] T 37568e9b29014c3e9276b04109023ab5 P 7a910d7b024e4df2993580f4f2923bb5 [term 1 FOLLOWER]: Refusing update from remote peer 5166c0ced7204d998d8062d51526bfbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:41.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.880664  3657 consensus_queue.cc:1048] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12f0866b0104f9ebf76bdc0cd56d7e9" member_type: VOTER last_known_addr { host: "127.2.42.66" port: 39741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:41.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.881361  3657 consensus_queue.cc:1048] T 37568e9b29014c3e9276b04109023ab5 P 5166c0ced7204d998d8062d51526bfbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a910d7b024e4df2993580f4f2923bb5" member_type: VOTER last_known_addr { host: "127.2.42.67" port: 34367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:41.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:41.902565  3670 mvcc.cc:204] Tried to move back new op lower bound from 7305085181450366976 to 7305085180271017984. Current Snapshot: MvccSnapshot[applied={T|T < 7305085181450366976}]
23:47:41.963 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:41.966 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:41.967 [DEBUG - main] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:47:41.968 [DEBUG - main] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:47:41.969 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.216.125:34537(127.2.216.125:34537)] Successfully connected to peer
23:47:41.969 [DEBUG - main] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:47:41.972 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.216.126:46485(127.2.216.126:46485)] Successfully connected to peer
23:47:41.983 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.216.124:33041(127.2.216.124:33041)] Successfully connected to peer
23:47:41.983 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.125
23:47:42.014 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.124
23:47:42.019 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.126
23:47:42.037 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:42.037 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:42.044 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xaf11d638, L:/127.0.0.1:37364 - R:/127.2.216.124:33041] using SASL/PLAIN
23:47:42.048 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe5688b1d, L:/127.0.0.1:49878 - R:/127.2.216.125:34537] using SASL/PLAIN
23:47:42.056 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:42.065 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe45912b9, L:/127.0.0.1:46682 - R:/127.2.216.126:46485] using SASL/PLAIN
23:47:42.069 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:42.070 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=103), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: OK, deferred=null) after lookup
23:47:42.079 [DEBUG - main] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:42.081 [DEBUG - main] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:42.083 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.42.126:45489(127.2.42.126:45489)] Successfully connected to peer
23:47:42.086 [DEBUG - main] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:42.091 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.42.125:42983(127.2.42.125:42983)] Successfully connected to peer
23:47:42.095 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.42.124:36407(127.2.42.124:36407)] Successfully connected to peer
23:47:42.100 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.125
23:47:42.104 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.126
23:47:42.110 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.124
23:47:42.170 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:42.176 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x23522628, L:/127.0.0.1:34968 - R:/127.2.42.126:45489] using SASL/PLAIN
23:47:42.179 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:42.183 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x59058ed5, L:/127.0.0.1:42876 - R:/127.2.42.124:36407] using SASL/PLAIN
23:47:42.186 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:42.188 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:42.189 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=110), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: OK, [109ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, deferred=null) after lookup
23:47:42.191 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x49f4f7f9, L:/127.0.0.1:37392 - R:/127.2.42.125:42983] using SASL/PLAIN
23:47:42.192 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:42.228 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:42.228 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:42.229 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.245553  2957 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46682:
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:47:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000"
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:47:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:42.248366  2957 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:47:42.298 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:42.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.389642  3403 tablet_service.cc:1511] Processing CreateTablet for tablet cd25869985854366aedfc8a5eae5b3e5 (DEFAULT_TABLE table=replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
23:47:42.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.392372  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd25869985854366aedfc8a5eae5b3e5. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:42.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.407203  3264 tablet_service.cc:1511] Processing CreateTablet for tablet cd25869985854366aedfc8a5eae5b3e5 (DEFAULT_TABLE table=replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
23:47:42.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.409354  3264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd25869985854366aedfc8a5eae5b3e5. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:42.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.413005  3546 tablet_service.cc:1511] Processing CreateTablet for tablet cd25869985854366aedfc8a5eae5b3e5 (DEFAULT_TABLE table=replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
23:47:42.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.415633  3546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd25869985854366aedfc8a5eae5b3e5. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:42.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.442467  3715 tablet_bootstrap.cc:492] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: Bootstrap starting.
23:47:42.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.449301  3715 tablet_bootstrap.cc:654] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: Neither blocks nor log segments found. Creating new log.
23:47:42.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.451623  3715 log.cc:826] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: Log is configured to *not* fsync() on all Append() calls
23:47:42.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.460021  3714 tablet_bootstrap.cc:492] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: Bootstrap starting.
23:47:42.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.467648  3715 tablet_bootstrap.cc:492] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: No bootstrap required, opened a new log
23:47:42.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.468803  3715 ts_tablet_manager.cc:1403] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
23:47:42.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.473894  3718 tablet_bootstrap.cc:492] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: Bootstrap starting.
23:47:42.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.479667  3715 raft_consensus.cc:359] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.480599  3718 tablet_bootstrap.cc:654] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: Neither blocks nor log segments found. Creating new log.
23:47:42.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.480669  3715 raft_consensus.cc:385] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:42.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.480860  3715 raft_consensus.cc:740] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1454f92b93f44b289278eda793906c7e, State: Initialized, Role: FOLLOWER
23:47:42.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.481925  3715 consensus_queue.cc:260] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.482748  3718 log.cc:826] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: Log is configured to *not* fsync() on all Append() calls
23:47:42.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.486891  3715 ts_tablet_manager.cc:1434] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
23:47:42.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.487802  3714 tablet_bootstrap.cc:654] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: Neither blocks nor log segments found. Creating new log.
23:47:42.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.490432  3714 log.cc:826] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: Log is configured to *not* fsync() on all Append() calls
23:47:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.493635  3718 tablet_bootstrap.cc:492] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: No bootstrap required, opened a new log
23:47:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.494407  3718 ts_tablet_manager.cc:1403] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
23:47:42.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.509227  3714 tablet_bootstrap.cc:492] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: No bootstrap required, opened a new log
23:47:42.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.509617  3714 ts_tablet_manager.cc:1403] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.004s
23:47:42.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.519474  3718 raft_consensus.cc:359] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.520143  3714 raft_consensus.cc:359] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.520726  3714 raft_consensus.cc:385] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:42.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.520865  3714 raft_consensus.cc:740] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2497782e9f38423697f3ef19daca47ce, State: Initialized, Role: FOLLOWER
23:47:42.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.520782  3718 raft_consensus.cc:385] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:42.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.521276  3718 raft_consensus.cc:740] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 071123ab2a624943b6d34ad7c2772e4e, State: Initialized, Role: FOLLOWER
23:47:42.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.521759  3714 consensus_queue.cc:260] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.522513  3718 consensus_queue.cc:260] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.532537  3718 ts_tablet_manager.cc:1434] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.004s
23:47:42.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.541456  3722 raft_consensus.cc:493] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:42.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.541846  3722 raft_consensus.cc:515] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.542977  3714 ts_tablet_manager.cc:1434] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: Time spent starting tablet: real 0.033s	user 0.026s	sys 0.008s
23:47:42.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.546089  3722 leader_election.cc:290] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211), 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:42.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.560639  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd25869985854366aedfc8a5eae5b3e5" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1454f92b93f44b289278eda793906c7e" is_pre_election: true
23:47:42.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.561228  3424 raft_consensus.cc:2468] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 0.
23:47:42.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.561122  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd25869985854366aedfc8a5eae5b3e5" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "071123ab2a624943b6d34ad7c2772e4e" is_pre_election: true
23:47:42.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.561637  3567 raft_consensus.cc:2468] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 0.
23:47:42.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.562110  3218 leader_election.cc:304] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1454f92b93f44b289278eda793906c7e, 2497782e9f38423697f3ef19daca47ce; no voters: 
23:47:42.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.562678  3722 raft_consensus.cc:2804] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:42.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.562922  3722 raft_consensus.cc:493] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:42.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.563095  3722 raft_consensus.cc:3060] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Advancing to term 1
23:47:42.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.565773  3722 raft_consensus.cc:515] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.566701  3722 leader_election.cc:290] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 election: Requested vote from peers 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211), 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:42.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.567217  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd25869985854366aedfc8a5eae5b3e5" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1454f92b93f44b289278eda793906c7e"
23:47:42.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.567378  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd25869985854366aedfc8a5eae5b3e5" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "071123ab2a624943b6d34ad7c2772e4e"
23:47:42.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.567600  3567 raft_consensus.cc:3060] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Advancing to term 1
23:47:42.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.567552  3424 raft_consensus.cc:3060] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Advancing to term 1
23:47:42.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:42.568629  3482 tablet.cc:2406] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:42.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.570524  3567 raft_consensus.cc:2468] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 1.
23:47:42.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.571182  3216 leader_election.cc:304] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 071123ab2a624943b6d34ad7c2772e4e, 2497782e9f38423697f3ef19daca47ce; no voters: 
23:47:42.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.571434  3424 raft_consensus.cc:2468] T cd25869985854366aedfc8a5eae5b3e5 P 1454f92b93f44b289278eda793906c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 1.
23:47:42.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.575094  3722 raft_consensus.cc:2804] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 1 FOLLOWER]: Leader election won for term 1
23:47:42.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.575435  3722 raft_consensus.cc:697] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [term 1 LEADER]: Becoming Leader. State: Replica: 2497782e9f38423697f3ef19daca47ce, State: Running, Role: LEADER
23:47:42.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.576076  3722 consensus_queue.cc:237] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.585981  2956 catalog_manager.cc:5696] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 2497782e9f38423697f3ef19daca47ce (127.2.216.65). New cstate: current_term: 1 leader_uuid: "2497782e9f38423697f3ef19daca47ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } health_report { overall_health: UNKNOWN } } }
23:47:42.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:42.676469  3615 tablet.cc:2406] T cd25869985854366aedfc8a5eae5b3e5 P 071123ab2a624943b6d34ad7c2772e4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:42.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.692346  2956 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46682:
23:47:42.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
23:47:42.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:42.702852  2956 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 456111b361ad49f490de2b9f01ca7f26 has no consensus state
23:47:42.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.711704  3403 tablet_service.cc:1511] Processing CreateTablet for tablet 456111b361ad49f490de2b9f01ca7f26 (DEFAULT_TABLE table=replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:47:42.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.711692  3546 tablet_service.cc:1511] Processing CreateTablet for tablet 456111b361ad49f490de2b9f01ca7f26 (DEFAULT_TABLE table=replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:47:42.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.712309  3546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456111b361ad49f490de2b9f01ca7f26. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:42.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.712327  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456111b361ad49f490de2b9f01ca7f26. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:42.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.715744  3264 tablet_service.cc:1511] Processing CreateTablet for tablet 456111b361ad49f490de2b9f01ca7f26 (DEFAULT_TABLE table=replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:47:42.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.716305  3264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456111b361ad49f490de2b9f01ca7f26. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:42.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.719004  3718 tablet_bootstrap.cc:492] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e: Bootstrap starting.
23:47:42.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.721555  3718 tablet_bootstrap.cc:654] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e: Neither blocks nor log segments found. Creating new log.
23:47:42.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.723516  3715 tablet_bootstrap.cc:492] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e: Bootstrap starting.
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.725714  3718 tablet_bootstrap.cc:492] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e: No bootstrap required, opened a new log
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.725930  3718 ts_tablet_manager.cc:1403] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e: Time spent bootstrapping tablet: real 0.007s	user 0.003s	sys 0.003s
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.726228  3714 tablet_bootstrap.cc:492] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce: Bootstrap starting.
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.727061  3715 tablet_bootstrap.cc:654] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e: Neither blocks nor log segments found. Creating new log.
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.727358  3718 raft_consensus.cc:359] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.727573  3718 raft_consensus.cc:385] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:42.727556  3332 tablet.cc:2406] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.727682  3718 raft_consensus.cc:740] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 071123ab2a624943b6d34ad7c2772e4e, State: Initialized, Role: FOLLOWER
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.728410  3714 tablet_bootstrap.cc:654] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce: Neither blocks nor log segments found. Creating new log.
23:47:42.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.728693  3718 consensus_queue.cc:260] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.729493  3718 ts_tablet_manager.cc:1434] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:47:42.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.734556  3715 tablet_bootstrap.cc:492] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e: No bootstrap required, opened a new log
23:47:42.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.734903  3715 ts_tablet_manager.cc:1403] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.005s
23:47:42.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.738576  3715 raft_consensus.cc:359] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.739096  3715 raft_consensus.cc:385] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:42.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.739372  3715 raft_consensus.cc:740] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1454f92b93f44b289278eda793906c7e, State: Initialized, Role: FOLLOWER
23:47:42.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.739918  3715 consensus_queue.cc:260] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.741262  3715 ts_tablet_manager.cc:1434] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
23:47:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.743001  3714 tablet_bootstrap.cc:492] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce: No bootstrap required, opened a new log
23:47:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.743023  2956 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 0b539e6213f740edbfc1f6ad8bdae0f5: replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e] alter complete (version 0)
23:47:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.743244  3714 ts_tablet_manager.cc:1403] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.000s
23:47:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.744342  3714 raft_consensus.cc:359] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.744552  3714 raft_consensus.cc:385] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.744649  3714 raft_consensus.cc:740] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2497782e9f38423697f3ef19daca47ce, State: Initialized, Role: FOLLOWER
23:47:42.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.744911  3714 consensus_queue.cc:260] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.745478  3714 ts_tablet_manager.cc:1434] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:47:42.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.752449  3722 raft_consensus.cc:493] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:42.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.752663  3722 raft_consensus.cc:515] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.753401  3722 leader_election.cc:290] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211), 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:42.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.754243  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456111b361ad49f490de2b9f01ca7f26" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1454f92b93f44b289278eda793906c7e" is_pre_election: true
23:47:42.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.754527  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456111b361ad49f490de2b9f01ca7f26" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "071123ab2a624943b6d34ad7c2772e4e" is_pre_election: true
23:47:42.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.754667  3424 raft_consensus.cc:2468] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 0.
23:47:42.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.754856  3567 raft_consensus.cc:2468] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 0.
23:47:42.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.755436  3216 leader_election.cc:304] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 071123ab2a624943b6d34ad7c2772e4e, 2497782e9f38423697f3ef19daca47ce; no voters: 
23:47:42.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.755787  3722 raft_consensus.cc:2804] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:42.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.755890  3722 raft_consensus.cc:493] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:42.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.755992  3722 raft_consensus.cc:3060] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 0 FOLLOWER]: Advancing to term 1
23:47:42.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:42.760205  2943 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 456111b361ad49f490de2b9f01ca7f26 (table replication_test_table [id=de49d7dbf39446c499cfcf1c9b16030e], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 456111b361ad49f490de2b9f01ca7f26 consensus state has no leader
23:47:42.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.760370  3722 raft_consensus.cc:515] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.761834  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456111b361ad49f490de2b9f01ca7f26" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1454f92b93f44b289278eda793906c7e"
23:47:42.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.762148  3424 raft_consensus.cc:3060] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [term 0 FOLLOWER]: Advancing to term 1
23:47:42.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.765666  3424 raft_consensus.cc:2468] T 456111b361ad49f490de2b9f01ca7f26 P 1454f92b93f44b289278eda793906c7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 1.
23:47:42.766 [DEBUG - main] (Connection.java:575) [peer master-127.2.42.124:36407(127.2.42.124:36407)] disconnecting while in state READY
23:47:42.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.766454  3218 leader_election.cc:304] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1454f92b93f44b289278eda793906c7e, 2497782e9f38423697f3ef19daca47ce; no voters: 
23:47:42.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.767014  3724 raft_consensus.cc:2804] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 1 FOLLOWER]: Leader election won for term 1
23:47:42.778 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.42.124:36407(127.2.42.124:36407)] handling channelInactive
23:47:42.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state READY due to: connection closed
23:47:42.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.773331  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456111b361ad49f490de2b9f01ca7f26" candidate_uuid: "2497782e9f38423697f3ef19daca47ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "071123ab2a624943b6d34ad7c2772e4e"
23:47:42.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.773720  3567 raft_consensus.cc:3060] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [term 0 FOLLOWER]: Advancing to term 1
23:47:42.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.779742  3567 raft_consensus.cc:2468] T 456111b361ad49f490de2b9f01ca7f26 P 071123ab2a624943b6d34ad7c2772e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2497782e9f38423697f3ef19daca47ce in term 1.
23:47:42.782 [DEBUG - main] (Connection.java:575) [peer master-127.2.42.125:42983(127.2.42.125:42983)] disconnecting while in state READY
23:47:42.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.783190  3722 leader_election.cc:290] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [CANDIDATE]: Term 1 election: Requested vote from peers 1454f92b93f44b289278eda793906c7e (127.2.216.66:42211), 071123ab2a624943b6d34ad7c2772e4e (127.2.216.67:36231)
23:47:42.784 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.42.125:42983(127.2.42.125:42983)] handling channelInactive
23:47:42.785 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state READY due to: connection closed
23:47:42.786 [DEBUG - main] (Connection.java:575) [peer master-127.2.42.126:45489(127.2.42.126:45489)] disconnecting while in state READY
23:47:42.788 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.42.126:45489(127.2.42.126:45489)] handling channelInactive
23:47:42.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state READY due to: connection closed
23:47:42.789 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:42.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.789186  3724 raft_consensus.cc:697] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [term 1 LEADER]: Becoming Leader. State: Replica: 2497782e9f38423697f3ef19daca47ce, State: Running, Role: LEADER
23:47:42.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.789768  3724 consensus_queue.cc:237] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } }
23:47:42.792 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
23:47:42.794 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:47:42.795 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-2
23:47:42.796 [DEBUG - main] (Connection.java:575) [peer master-127.2.216.126:46485(127.2.216.126:46485)] disconnecting while in state READY
23:47:42.797 [DEBUG - main] (Connection.java:575) [peer master-127.2.216.125:34537(127.2.216.125:34537)] disconnecting while in state READY
23:47:42.797 [DEBUG - main] (Connection.java:575) [peer master-127.2.216.124:33041(127.2.216.124:33041)] disconnecting while in state READY
23:47:42.798 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.216.126:46485(127.2.216.126:46485)] handling channelInactive
23:47:42.798 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.216.125:34537(127.2.216.125:34537)] handling channelInactive
23:47:42.798 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state READY due to: connection closed
23:47:42.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state READY due to: connection closed
23:47:42.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.797731  2957 catalog_manager.cc:5696] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 2497782e9f38423697f3ef19daca47ce (127.2.216.65). New cstate: current_term: 1 leader_uuid: "2497782e9f38423697f3ef19daca47ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2497782e9f38423697f3ef19daca47ce" member_type: VOTER last_known_addr { host: "127.2.216.65" port: 34053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 } health_report { overall_health: UNKNOWN } } }
23:47:42.798 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.216.124:33041(127.2.216.124:33041)] handling channelInactive
23:47:42.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state READY due to: connection closed
23:47:42.801 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:42.802 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:47:42.805 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
23:47:42.808 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:47:42.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.980978  3724 consensus_queue.cc:1048] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:42.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:42.996644  3722 consensus_queue.cc:1048] T cd25869985854366aedfc8a5eae5b3e5 P 2497782e9f38423697f3ef19daca47ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:43.049 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:47:43.051 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:47:43.051 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:47:43.052 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:47:43.052 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:47:43.058 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:47:43.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:43.332428  3731 consensus_queue.cc:1048] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "1454f92b93f44b289278eda793906c7e" member_type: VOTER last_known_addr { host: "127.2.216.66" port: 42211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:43.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:43.342996  3731 consensus_queue.cc:1048] T 456111b361ad49f490de2b9f01ca7f26 P 2497782e9f38423697f3ef19daca47ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "071123ab2a624943b6d34ad7c2772e4e" member_type: VOTER last_known_addr { host: "127.2.216.67" port: 36231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:43.381 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:47:43.381 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:47:43.381 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:47:43.382 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:47:43.382 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:47:43.382 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:47:43.386 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:47:43.700 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:47:43.778 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:47:43.778 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:47:43.778 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:47:43.800 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:47:44.701 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:47:44.913 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:47:44.953 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:47:44.978 [INFO - flink-metrics-6] (Slf4jLogger.scala:117) Slf4jLogger started
23:47:44.995 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:47:45.020 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:47:45.169 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:47:45.179 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:47:45.179 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:47:45.189 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:47:45.191 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:47:45.193 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:47:45.193 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:47:45.194 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:47:45.197 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:47:45.197 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:47:45.198 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:47:45.200 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:47:45.200 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:47:45.200 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:47:45.200 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:47:45.200 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:47:45.204 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:47:45.204 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:47:45.204 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:47:45.205 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:47:45.206 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:47:45.207 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:47:45.207 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:47:45.207 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:47:45.224 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_5bd38ec3f6730f8ba85b20b8443dee43/blobStorage
23:47:45.232 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:32973 - max concurrent requests: 50 - max backlog: 1000
23:47:45.243 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_5bd38ec3f6730f8ba85b20b8443dee43/blobStorage
23:47:45.246 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_5bd38ec3f6730f8ba85b20b8443dee43/blobStorage
23:47:45.248 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:47:45.255 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: da593351-5360-4df4-b8eb-178268a89f7c
23:47:45.292 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:47:45.298 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-2811c08a-9b94-41f9-a2bf-1733ecb1ea47
23:47:45.315 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-c199c989-5fdb-46a2-b873-7f986a5b9861
23:47:45.579 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:47:45.602 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:47:45.602 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:47:45.605 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:47:45.660 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:47:45.676 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_0 .
23:47:45.728 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
23:47:45.730 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-620c1253-d135-4f91-a463-14e249652635
23:47:45.842 [INFO - main] (RestServerEndpoint.java:567) Upload directory /tmp/flink-web-upload does not exist. 
23:47:45.842 [INFO - main] (RestServerEndpoint.java:592) Created directory /tmp/flink-web-upload for file uploads.
23:47:45.847 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:47:45.849 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:47:46.221 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:47:46.221 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:47:46.368 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:36607
23:47:46.368 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:47:46.371 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:36607 was granted leadership with leaderSessionID=a13c7ee3-fa00-4513-998d-a8160b44eba8
23:47:46.371 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:36607 , session=a13c7ee3-fa00-4513-998d-a8160b44eba8
23:47:46.386 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:47:46.386 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:47:46.386 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:47:46.387 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 2add7f43-ce42-48f2-927f-cdb7be67f035. Creating new DispatcherLeaderProcess.
23:47:46.389 [INFO - pool-11-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 9ad1fa4a-3c1b-466b-b01a-f4c3c5b96699.
23:47:46.395 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:47:46.395 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:47:46.401 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:47:46.401 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:47:46.426 [INFO - pool-11-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_1 .
23:47:46.427 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_2 .
23:47:46.458 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
23:47:46.463 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:47:46.464 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:47:46.465 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:47:46.465 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:47:46.465 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_1 , session=9ad1fa4a-3c1b-466b-b01a-f4c3c5b96699
23:47:46.468 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_1(b01af4c3c5b966999ad1fa4a3c1b466b).
23:47:46.470 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_2 , session=2add7f43-ce42-48f2-927f-cdb7be67f035
23:47:46.514 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:47:46.521 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID da593351-5360-4df4-b8eb-178268a89f7c (pekko://flink/user/rpc/taskmanager_0) at ResourceManager
23:47:46.525 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_1 under registration id 76de4d1ba2e1c775bf8a24697697ddfd.
23:47:46.527 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (bbc34d76ac15add629743db00c4f4a33).
23:47:46.527 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:344) Registering task executor da593351-5360-4df4-b8eb-178268a89f7c under 76de4d1ba2e1c775bf8a24697697ddfd at the slot manager.
23:47:46.530 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (bbc34d76ac15add629743db00c4f4a33).
23:47:46.545 [INFO - flink-pekko.actor.default-dispatcher-5] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-bbc34d76ac15add629743db00c4f4a33'.
23:47:46.548 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job bbc34d76ac15add629743db00c4f4a33 was granted leadership with leader id 9bddb8f1-e66f-490a-9bbe-59ca9714e1b3. Creating new JobMasterServiceProcess.
23:47:46.565 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_3 .
23:47:46.576 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (bbc34d76ac15add629743db00c4f4a33).
23:47:46.613 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33).
23:47:46.667 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph bb540fbba10c0880a91d0f440f653aae for job bbc34d76ac15add629743db00c4f4a33.
23:47:46.693 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33).
23:47:46.694 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:47:46.751 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 3 ms, total 4 pipelined regions currently.
23:47:46.762 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@41ed0e96
23:47:46.762 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:47:46.764 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:47:46.809 [INFO - jobmanager-io-thread-1] (FileSystem.java:1139) Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
23:47:46.844 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:47:46.854 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@61062a8c for Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33).
23:47:46.870 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_3 , session=9bddb8f1-e66f-490a-9bbe-59ca9714e1b3
23:47:46.873 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (bbc34d76ac15add629743db00c4f4a33) under job master id 9bbe59ca9714e1b39bddb8f1e66f490a.
23:47:46.877 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:47:46.882 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:46.887 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:47:46.888 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state CREATED to RUNNING.
23:47:46.895 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:46.897 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:46.898 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.42.126:45489(127.2.42.126:45489)] Successfully connected to peer
23:47:46.900 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:46.902 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:47:46.905 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.42.125:42983(127.2.42.125:42983)] Successfully connected to peer
23:47:46.913 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.126
23:47:46.936 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.125
23:47:46.939 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.42.124:36407(127.2.42.124:36407)] Successfully connected to peer
23:47:46.954 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:46.960 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0e3676ab, L:/127.0.0.1:34984 - R:/127.2.42.126:45489] using SASL/PLAIN
23:47:46.966 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:47:46.967 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.124
23:47:46.967 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:46.967 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:47:46.968 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:47:46.969 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_1(b01af4c3c5b966999ad1fa4a3c1b466b)
23:47:46.971 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x74df834d, L:/127.0.0.1:37408 - R:/127.2.42.125:42983] using SASL/PLAIN
23:47:46.973 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:47:46.975 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager 9bbe59ca9714e1b39bddb8f1e66f490a@pekko://flink/user/rpc/jobmanager_3 for job bbc34d76ac15add629743db00c4f4a33.
23:47:46.984 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:46.993 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2bc00fc7, L:/127.0.0.1:42890 - R:/127.2.42.124:36407] using SASL/PLAIN
23:47:46.998 [DEBUG - main] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:47:46.999 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:46.999 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=106), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [69ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, deferred=null) after lookup
23:47:47.003 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager 9bbe59ca9714e1b39bddb8f1e66f490a@pekko://flink/user/rpc/jobmanager_3 for job bbc34d76ac15add629743db00c4f4a33.
23:47:47.004 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:47.009 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:47.009 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:47.009 [DEBUG - main] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:47:47.009 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:47.010 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.216.125:34537(127.2.216.125:34537)] Successfully connected to peer
23:47:47.016 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b01af4c3c5b966999ad1fa4a3c1b466b.
23:47:47.019 [DEBUG - main] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:47:47.020 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:47:47.022 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.216.126:46485(127.2.216.126:46485)] Successfully connected to peer
23:47:47.029 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.125
23:47:47.039 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.216.124:33041(127.2.216.124:33041)] Successfully connected to peer
23:47:47.039 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.126
23:47:47.045 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.124
23:47:47.051 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.055 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x68770f08, L:/127.0.0.1:49892 - R:/127.2.216.125:34537] using SASL/PLAIN
23:47:47.057 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.064 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa3f93c04, L:/127.0.0.1:46698 - R:/127.2.216.126:46485] using SASL/PLAIN
23:47:47.066 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.070 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x75016ffb, L:/127.0.0.1:37378 - R:/127.2.216.124:33041] using SASL/PLAIN
23:47:47.072 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:47.072 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=78), Traces: [0ms] refreshing cache from master, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: OK, deferred=null) after lookup
23:47:47.075 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.093 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job bbc34d76ac15add629743db00c4f4a33
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager da593351-5360-4df4-b8eb-178268a89f7c
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:47:47.097 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet cd25869985854366aedfc8a5eae5b3e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:47.097 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 456111b361ad49f490de2b9f01ca7f26 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:47.098 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=cd25869985854366aedfc8a5eae5b3e5@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=456111b361ad49f490de2b9f01ca7f26@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:47.102 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 6b51d7ad62a6e78a6dc9bd0d754a4758 from da593351-5360-4df4-b8eb-178268a89f7c for job bbc34d76ac15add629743db00c4f4a33 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.106 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.216.126:46485, [6ms] Sub RPC GetTableLocations: received response from server master-127.2.216.126:46485: OK, deferred=null)) after lookup
23:47:47.107 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 6b51d7ad62a6e78a6dc9bd0d754a4758 for job bbc34d76ac15add629743db00c4f4a33 from resource manager with leader id b01af4c3c5b966999ad1fa4a3c1b466b.
23:47:47.108 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 6b51d7ad62a6e78a6dc9bd0d754a4758 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.113 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1216e8b0e1b553c01c5280d36e41ebbe from da593351-5360-4df4-b8eb-178268a89f7c for job bbc34d76ac15add629743db00c4f4a33 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.114 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1bd3793e55039b5af4eb141e2853b12c from da593351-5360-4df4-b8eb-178268a89f7c for job bbc34d76ac15add629743db00c4f4a33 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.115 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a99a26b3c149ad5cb3552c0905824cfc from da593351-5360-4df4-b8eb-178268a89f7c for job bbc34d76ac15add629743db00c4f4a33 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.121 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:192) Add job bbc34d76ac15add629743db00c4f4a33 for job leader monitoring.
23:47:47.123 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] connecting to peer
23:47:47.123 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_3 with leader id 9bddb8f1-e66f-490a-9bbe-59ca9714e1b3.
23:47:47.125 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 1216e8b0e1b553c01c5280d36e41ebbe for job bbc34d76ac15add629743db00c4f4a33 from resource manager with leader id b01af4c3c5b966999ad1fa4a3c1b466b.
23:47:47.125 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:47:47.126 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 1216e8b0e1b553c01c5280d36e41ebbe with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.126 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 1bd3793e55039b5af4eb141e2853b12c for job bbc34d76ac15add629743db00c4f4a33 from resource manager with leader id b01af4c3c5b966999ad1fa4a3c1b466b.
23:47:47.126 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 1bd3793e55039b5af4eb141e2853b12c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.128 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request a99a26b3c149ad5cb3552c0905824cfc for job bbc34d76ac15add629743db00c4f4a33 from resource manager with leader id b01af4c3c5b966999ad1fa4a3c1b466b.
23:47:47.128 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for a99a26b3c149ad5cb3552c0905824cfc with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:47:47.133 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_3 for job bbc34d76ac15add629743db00c4f4a33.
23:47:47.134 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1783) Establish JobManager connection for job bbc34d76ac15add629743db00c4f4a33.
23:47:47.141 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] Successfully connected to peer
23:47:47.138 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1633) Offer reserved slots to the leader of job bbc34d76ac15add629743db00c4f4a33.
23:47:47.176 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:47:47.177 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id 1216e8b0e1b553c01c5280d36e41ebbe
23:47:47.181 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.181 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1216e8b0e1b553c01c5280d36e41ebbe.
23:47:47.188 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x2ed85c50, L:/127.0.0.1:43532 - R:/127.2.216.65:34053] using TOKEN/null
23:47:47.196 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:47:47.196 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758
23:47:47.198 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:47:47.198 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id 1bd3793e55039b5af4eb141e2853b12c
23:47:47.200 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:47:47.200 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id a99a26b3c149ad5cb3552c0905824cfc
23:47:47.280 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:47:47.291 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job bbc34d76ac15add629743db00c4f4a33.
23:47:47.309 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:84) StateChangelogStorageLoader initialized with shortcut names {memory,filesystem}.
23:47:47.309 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:47:47.325 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.326 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.341 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.343 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.354 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id bbc34d76ac15add629743db00c4f4a33
23:47:47.367 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 1216e8b0e1b553c01c5280d36e41ebbe.
23:47:47.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:47:47.372 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:47:47.373 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:47:47.382 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:47:47.385 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:47:47.385 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1bd3793e55039b5af4eb141e2853b12c.
23:47:47.386 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:47:47.395 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 1bd3793e55039b5af4eb141e2853b12c.
23:47:47.396 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot a99a26b3c149ad5cb3552c0905824cfc.
23:47:47.397 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:47:47.398 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:47:47.402 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.403 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.405 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id a99a26b3c149ad5cb3552c0905824cfc.
23:47:47.410 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1216e8b0e1b553c01c5280d36e41ebbe.
23:47:47.410 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:47:47.410 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1bd3793e55039b5af4eb141e2853b12c.
23:47:47.410 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot a99a26b3c149ad5cb3552c0905824cfc.
23:47:47.412 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.412 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:47:47.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:47:47.445 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@24b44192
23:47:47.445 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:47:47.446 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60ded268
23:47:47.446 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:47:47.446 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:47:47.445 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37fbb95d
23:47:47.447 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:47:47.447 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:47:47.449 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:47:47.455 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ae8af75
23:47:47.455 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:47:47.456 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:47:47.461 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:47:47.463 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:47:47.463 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:47:47.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:47:47.467 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:47:47.471 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.471 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.477 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:47:47.479 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.481 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:47:47.482 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:47:47.505 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.563 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.564 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.570 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.571 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.604 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@766d88e6
23:47:47.607 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@8f36bf7
23:47:47.607 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52beb3ed
23:47:47.609 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28f22616
23:47:47.630 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.630 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.638 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.668 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:47:47.669 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:47.672 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:47:47.696 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.696 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.702 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.702 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.704 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:47.705 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:47.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:47:47.707 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.216.125:34537(127.2.216.125:34537)] Successfully connected to peer
23:47:47.709 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:47.711 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:47:47.715 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:47:47.717 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.216.124:33041(127.2.216.124:33041)] Successfully connected to peer
23:47:47.721 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.125
23:47:47.728 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:47:47.730 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:47:47.732 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:47:47.732 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.124
23:47:47.733 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.216.125:34537(127.2.216.125:34537)] Successfully connected to peer
23:47:47.745 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:47:47.747 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.216.126:46485(127.2.216.126:46485)] Successfully connected to peer
23:47:47.749 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:47:47.749 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.125
23:47:47.752 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.126
23:47:47.760 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.761 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.765 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.766 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.766 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.216.125:34537(127.2.216.125:34537)] Successfully connected to peer
23:47:47.775 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.216.124:33041(127.2.216.124:33041)] Successfully connected to peer
23:47:47.776 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:47:47.778 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.216.124:33041(127.2.216.124:33041)] Successfully connected to peer
23:47:47.782 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.125
23:47:47.787 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.793 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.795 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.124
23:47:47.799 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:47:47.801 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x64653ab1, L:/127.0.0.1:46714 - R:/127.2.216.126:46485] using SASL/PLAIN
23:47:47.801 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.216.125:34537(127.2.216.125:34537)] Successfully connected to peer
23:47:47.804 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.805 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.808 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:47.808 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.808 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=102), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [97ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: OK, deferred=null) after lookup
23:47:47.809 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:47:47.811 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa1ffed7e, L:/127.0.0.1:49922 - R:/127.2.216.125:34537] using SASL/PLAIN
23:47:47.813 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7bb1fbc2, L:/127.0.0.1:49908 - R:/127.2.216.125:34537] using SASL/PLAIN
23:47:47.813 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.816 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.216.124:33041(127.2.216.124:33041)] Successfully connected to peer
23:47:47.820 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.821 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49f60b43
23:47:47.824 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.824 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.829 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.833 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.838 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdbe3570f, L:/127.0.0.1:49900 - R:/127.2.216.125:34537] using SASL/PLAIN
23:47:47.840 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.125
23:47:47.846 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.124
23:47:47.848 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.216.126:46485(127.2.216.126:46485)] Successfully connected to peer
23:47:47.850 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.126
23:47:47.853 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.124
23:47:47.861 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.863 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x173cd741, L:/127.0.0.1:37382 - R:/127.2.216.124:33041] using SASL/PLAIN
23:47:47.870 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbf1bb269, L:/127.0.0.1:37408 - R:/127.2.216.124:33041] using SASL/PLAIN
23:47:47.872 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:47:47.874 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:47:47.889 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.889 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.893 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.216.126:46485(127.2.216.126:46485)] Successfully connected to peer
23:47:47.900 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.901 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.866 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.919 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.126
23:47:47.923 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.216.126:46485(127.2.216.126:46485)] Successfully connected to peer
23:47:47.926 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.216.126
23:47:47.935 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.937 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x20776f49, L:/127.0.0.1:37398 - R:/127.2.216.124:33041] using SASL/PLAIN
23:47:47.941 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x42831748, L:/127.0.0.1:37418 - R:/127.2.216.124:33041] using SASL/PLAIN
23:47:47.945 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.947 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.950 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb88ed1c3, L:/127.0.0.1:46730 - R:/127.2.216.126:46485] using SASL/PLAIN
23:47:47.951 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x99c111ac, L:/127.0.0.1:46744 - R:/127.2.216.126:46485] using SASL/PLAIN
23:47:47.942 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.956 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.956 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:47.957 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:47.957 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=247), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [85ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: OK, [151ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: OK, deferred=null) after lookup
23:47:47.962 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9be3f6ec, L:/127.0.0.1:49934 - R:/127.2.216.125:34537] using SASL/PLAIN
23:47:47.964 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.965 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:47.965 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:47.965 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=295), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: OK, [208ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: OK, [291ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: OK, deferred=null) after lookup
23:47:47.966 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:47.969 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.969 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27dc5e70
23:47:47.971 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:47.972 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:47:47.972 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:47:47.974 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:47:47.975 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='701881adb5d485b1d4729a47753a1b3a756c650d3060d79b998479f062ca9f85'}]
23:47:47.978 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4022e86d, L:/127.0.0.1:46718 - R:/127.2.216.126:46485] using SASL/PLAIN
23:47:47.980 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:47.981 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.984 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.984 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:47.984 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=279), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [220ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: OK, deferred=null) after lookup
23:47:47.984 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28a1d7c6
23:47:47.989 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:47:47.989 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:47.989 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:47:47.989 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='99ab3aef4bb1d00d4f2af440643d6b6bd30d63df2c3cd0968a308ab73d57922e'}]
23:47:47.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:47:47.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:47:47.993 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:47.997 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:47:47.999 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:47:47.999 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:47:48.000 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:48.001 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39df5fc1
23:47:48.004 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}]
23:47:48.007 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:47:48.008 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:47:48.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:47:48.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:47:48.009 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299997, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}]
23:47:48.011 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:47:48.011 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:47:48.012 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:48.013 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] connecting to peer
23:47:48.015 [DEBUG - kudu-nio-0] (Connection.java:757) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] Successfully connected to peer
23:47:48.015 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] Successfully connected to peer
23:47:48.019 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.66
23:47:48.019 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.67
23:47:48.022 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.023 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.027 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.027 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.034 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:48.035 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:48.042 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5776d460, L:/127.0.0.1:41858 - R:/127.2.42.66:39741] using SASL/PLAIN
23:47:48.050 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf71b3a5d, L:/127.0.0.1:39374 - R:/127.2.42.67:34367] using SASL/PLAIN
23:47:48.077 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7305085201993728001) for scanner KuduScanner(table=replication_test_table, tablet=37568e9b29014c3e9276b04109023ab5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.081 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [99ab3aef4bb1d00d4f2af440643d6b6bd30d63df2c3cd0968a308ab73d57922e]
23:47:48.087 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:47:48.087 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.088 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.094 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.096 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.105 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7305085201993728001) for scanner KuduScanner(table=replication_test_table, tablet=84f439a803514545aa7850275652b318, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.106 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [701881adb5d485b1d4729a47753a1b3a756c650d3060d79b998479f062ca9f85]
23:47:48.107 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:47:48.156 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.157 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.163 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.163 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.180 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468068169 for job bbc34d76ac15add629743db00c4f4a33.
23:47:48.187 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet cd25869985854366aedfc8a5eae5b3e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:48.188 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 456111b361ad49f490de2b9f01ca7f26 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.188 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=cd25869985854366aedfc8a5eae5b3e5@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=456111b361ad49f490de2b9f01ca7f26@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.193 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 456111b361ad49f490de2b9f01ca7f26 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.193 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=456111b361ad49f490de2b9f01ca7f26@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.199 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [701881adb5d485b1d4729a47753a1b3a756c650d3060d79b998479f062ca9f85]
23:47:48.222 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.222 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.224 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=195, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@429013c4, flushNotification=Deferred@1387338534(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:47:48.232 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.233 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.233 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:47:48.234 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:47:48.234 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] disconnecting while in state READY
23:47:48.237 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 701881adb5d485b1d4729a47753a1b3a756c650d3060d79b998479f062ca9f85 finished by subtask 0; deferring removal (restored in pending)
23:47:48.239 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=5, operationSize=315, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@25c3d55f, flushNotification=Deferred@316489978(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:47:48.245 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:48.252 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] connecting to peer
23:47:48.254 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] connecting to peer
23:47:48.291 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.291 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.297 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.298 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.301 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] Successfully connected to peer
23:47:48.315 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] handling channelInactive
23:47:48.316 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state READY due to: connection closed
23:47:48.316 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:47:48.316 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:47:48.321 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] Successfully connected to peer
23:47:48.354 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.355 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.361 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.361 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.383 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:48.388 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:48.393 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x38be290f, L:/127.0.0.1:43542 - R:/127.2.216.65:34053] using TOKEN/null
23:47:48.403 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x0242a403, L:/127.0.0.1:43536 - R:/127.2.216.65:34053] using TOKEN/null
23:47:48.420 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.420 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.448 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.449 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.510 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.510 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.519 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.519 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [99ab3aef4bb1d00d4f2af440643d6b6bd30d63df2c3cd0968a308ab73d57922e]
23:47:48.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:47:48.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:47:48.570 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] disconnecting while in state READY
23:47:48.571 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:48.575 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 99ab3aef4bb1d00d4f2af440643d6b6bd30d63df2c3cd0968a308ab73d57922e finished by subtask 1; deferring removal (restored in pending)
23:47:48.580 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.580 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.587 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.588 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.612 [DEBUG - kudu-nio-0] (Connection.java:239) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] handling channelInactive
23:47:48.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] cleaning up while in state READY due to: connection closed
23:47:48.613 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:47:48.613 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:47:48.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.647 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.655 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.656 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.659 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job bbc34d76ac15add629743db00c4f4a33 (2232 bytes, checkpointDuration=477 ms, finalizationTime=13 ms).
23:47:48.664 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:47:48.664 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 99ab3aef4bb1d00d4f2af440643d6b6bd30d63df2c3cd0968a308ab73d57922e from pending
23:47:48.665 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 701881adb5d485b1d4729a47753a1b3a756c650d3060d79b998479f062ca9f85 from pending
23:47:48.665 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 2 finished splits from enumerator state
23:47:48.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468068667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:48.684 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=130, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@24f70657, flushNotification=Deferred@76688075(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:47:48.715 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.716 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.723 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job bbc34d76ac15add629743db00c4f4a33 (964 bytes, checkpointDuration=41 ms, finalizationTime=15 ms).
23:47:48.724 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.724 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.728 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:47:48.729 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:48.732 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:48.736 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:48.742 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:48.747 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:48.748 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.748 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.756 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet cd25869985854366aedfc8a5eae5b3e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:48.756 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 456111b361ad49f490de2b9f01ca7f26 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.757 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=cd25869985854366aedfc8a5eae5b3e5@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=456111b361ad49f490de2b9f01ca7f26@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.765 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:48.771 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table de49d7dbf39446c499cfcf1c9b16030e
23:47:48.776 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:48.776 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.777 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.777 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [5ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, deferred=null)) after lookup
23:47:48.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=84f439a803514545aa7850275652b318, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 84f439a803514545aa7850275652b318 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.802 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=37568e9b29014c3e9276b04109023ab5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.803 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 37568e9b29014c3e9276b04109023ab5 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.807 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet cd25869985854366aedfc8a5eae5b3e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:48.808 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 456111b361ad49f490de2b9f01ca7f26 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.808 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=cd25869985854366aedfc8a5eae5b3e5@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=456111b361ad49f490de2b9f01ca7f26@[071123ab2a624943b6d34ad7c2772e4e(127.2.216.67:36231),1454f92b93f44b289278eda793906c7e(127.2.216.66:42211),2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.808 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.216.126:46485, [3ms] Sub RPC GetTableLocations: received response from server master-127.2.216.126:46485: OK, deferred=null)) after lookup
23:47:48.817 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.818 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.825 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.826 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.835 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=84f439a803514545aa7850275652b318, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.836 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 84f439a803514545aa7850275652b318 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.853 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=37568e9b29014c3e9276b04109023ab5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.854 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 37568e9b29014c3e9276b04109023ab5 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.899 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=cd25869985854366aedfc8a5eae5b3e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.899 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet cd25869985854366aedfc8a5eae5b3e5 for partition [0x80000000, 0x80000032) with scanner id null
23:47:48.900 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:48.906 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:48.906 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:48.906 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:48.913 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=456111b361ad49f490de2b9f01ca7f26, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:48.913 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 456111b361ad49f490de2b9f01ca7f26 for partition [0x80000064, 0x800000C8) with scanner id null
23:47:48.914 [DEBUG - main] (Connection.java:575) [peer master-127.2.216.126:46485(127.2.216.126:46485)] disconnecting while in state READY
23:47:48.914 [DEBUG - main] (Connection.java:575) [peer master-127.2.216.125:34537(127.2.216.125:34537)] disconnecting while in state READY
23:47:48.914 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3f713f6f37d09f3e5d600bac6cf9af1e8ba2d8f355ff0d2f2a8974b1f818a520'}]
23:47:48.914 [DEBUG - main] (Connection.java:575) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] disconnecting while in state READY
23:47:48.914 [DEBUG - main] (Connection.java:575) [peer master-127.2.216.124:33041(127.2.216.124:33041)] disconnecting while in state READY
23:47:48.915 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.216.126:46485(127.2.216.126:46485)] handling channelInactive
23:47:48.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state READY due to: connection closed
23:47:48.917 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:48.918 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d7db5a534d4b74a00c72e9df130a5cb84efa32d3a2ae89e97af8a52d1159bbef'}]
23:47:48.921 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:48.923 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:48.923 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] handling channelInactive
23:47:48.923 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] cleaning up while in state READY due to: connection closed
23:47:48.924 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.216.125:34537(127.2.216.125:34537)] handling channelInactive
23:47:48.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state READY due to: connection closed
23:47:48.925 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:47:48.925 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-2
23:47:48.927 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
23:47:48.936 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:47:48.937 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299994, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}]
23:47:48.944 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:47:48.945 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299994, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}]
23:47:48.960 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.216.124:33041(127.2.216.124:33041)] handling channelInactive
23:47:48.961 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state READY due to: connection closed
23:47:48.961 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:47:48.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:48.962682  2913 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 3200
23:47:48.970 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:48.995 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] connecting to peer
23:47:49.010 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] Successfully connected to peer
23:47:49.021 [DEBUG - kudu-nio-0] (Connection.java:757) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] Successfully connected to peer
23:47:49.027 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.67
23:47:49.055 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:49.058 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.66
23:47:49.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.073009  3324 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:49.076 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2db170f6, L:/127.0.0.1:39382 - R:/127.2.42.67:34367] using SASL/PLAIN
23:47:49.100 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:49.121 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfb964e3d, L:/127.0.0.1:41870 - R:/127.2.42.66:39741] using SASL/PLAIN
23:47:49.128 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085210177536001) for scanner KuduScanner(table=replication_test_table, tablet=84f439a803514545aa7850275652b318, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:49.131 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [3f713f6f37d09f3e5d600bac6cf9af1e8ba2d8f355ff0d2f2a8974b1f818a520]
23:47:49.134 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3f713f6f37d09f3e5d600bac6cf9af1e8ba2d8f355ff0d2f2a8974b1f818a520]
23:47:49.134 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:47:49.134 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:47:49.136 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] disconnecting while in state READY
23:47:49.136 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3f713f6f37d09f3e5d600bac6cf9af1e8ba2d8f355ff0d2f2a8974b1f818a520 finished by subtask 3; deferring removal (restored in pending)
23:47:49.137 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:49.173 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468069167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:49.179 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] handling channelInactive
23:47:49.179 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state READY due to: connection closed
23:47:49.180 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:47:49.180 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:47:49.200 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job bbc34d76ac15add629743db00c4f4a33 (2252 bytes, checkpointDuration=32 ms, finalizationTime=1 ms).
23:47:49.203 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:47:49.204 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 3 complete: removed split 3f713f6f37d09f3e5d600bac6cf9af1e8ba2d8f355ff0d2f2a8974b1f818a520 from pending
23:47:49.204 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 3 complete: removed 1 finished splits from enumerator state
23:47:49.217 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085210177536001) for scanner KuduScanner(table=replication_test_table, tablet=37568e9b29014c3e9276b04109023ab5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:49.218 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [d7db5a534d4b74a00c72e9df130a5cb84efa32d3a2ae89e97af8a52d1159bbef]
23:47:49.218 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d7db5a534d4b74a00c72e9df130a5cb84efa32d3a2ae89e97af8a52d1159bbef]
23:47:49.219 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:47:49.219 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:47:49.220 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] disconnecting while in state READY
23:47:49.221 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d7db5a534d4b74a00c72e9df130a5cb84efa32d3a2ae89e97af8a52d1159bbef finished by subtask 2; deferring removal (restored in pending)
23:47:49.222 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:49.252 [DEBUG - kudu-nio-0] (Connection.java:239) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] handling channelInactive
23:47:49.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] cleaning up while in state READY due to: connection closed
23:47:49.253 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:47:49.253 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:47:49.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.405047  2913 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 3200
23:47:49.465 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] handling channelInactive
23:47:49.465 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] cleaning up while in state READY due to: connection closed
23:47:49.466 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] handling channelInactive
23:47:49.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] cleaning up while in state READY due to: connection closed
23:47:49.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.469549  2913 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 3339
23:47:49.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.491555  3466 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:49.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468069667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:49.701 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=33 ms, finalizationTime=1 ms).
23:47:49.705 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:47:49.705 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split d7db5a534d4b74a00c72e9df130a5cb84efa32d3a2ae89e97af8a52d1159bbef from pending
23:47:49.705 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
23:47:49.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.772490  2913 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 3339
23:47:49.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.803216  2913 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 3478
23:47:49.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:49.830147  3607 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:50.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.059988  2913 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 3478
23:47:50.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.089087  2913 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2925
23:47:50.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.090562  2987 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:50.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468070167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:50.206 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job bbc34d76ac15add629743db00c4f4a33 (964 bytes, checkpointDuration=38 ms, finalizationTime=1 ms).
23:47:50.210 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:47:50.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.378845  2913 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2925
23:47:50.413 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.216.126:46485(127.2.216.126:46485)] handling channelInactive
23:47:50.413 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.216.126:46485(127.2.216.126:46485)] handling channelInactive
23:47:50.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state READY due to: connection closed
23:47:50.414 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.216.126:46485(127.2.216.126:46485)] handling channelInactive
23:47:50.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state READY due to: connection closed
23:47:50.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:50.415007  3087 connection.cc:573] server connection from 127.0.0.1:41716 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:47:50.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.415184  2913 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2994
23:47:50.416 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.216.126:46485(127.2.216.126:46485)] handling channelInactive
23:47:50.416 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state READY due to: connection closed
23:47:50.416 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state READY due to: connection closed
23:47:50.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.417640  3059 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:50.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.562845  2913 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2994
23:47:50.585 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.216.125:34537(127.2.216.125:34537)] handling channelInactive
23:47:50.585 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.216.125:34537(127.2.216.125:34537)] handling channelInactive
23:47:50.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state READY due to: connection closed
23:47:50.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state READY due to: connection closed
23:47:50.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.585978  2913 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 3066
23:47:50.586 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.216.125:34537(127.2.216.125:34537)] handling channelInactive
23:47:50.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state READY due to: connection closed
23:47:50.587 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.216.125:34537(127.2.216.125:34537)] handling channelInactive
23:47:50.587 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state READY due to: connection closed
23:47:50.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.587302  3133 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:50.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468070667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:50.683 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job bbc34d76ac15add629743db00c4f4a33 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:47:50.684 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:47:50.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.715054  2913 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 3066
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.216.124:33041(127.2.216.124:33041)] handling channelInactive
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.216.124:33041(127.2.216.124:33041)] handling channelInactive
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state READY due to: connection closed
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.216.124:33041(127.2.216.124:33041)] handling channelInactive
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state READY due to: connection closed
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.216.124:33041(127.2.216.124:33041)] handling channelInactive
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state READY due to: connection closed
23:47:50.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state READY due to: connection closed
23:47:50.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:50Z chronyd exiting
23:47:50.875 [DEBUG - main] (Connection.java:575) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] disconnecting while in state READY
23:47:50.875 [DEBUG - main] (Connection.java:575) [peer master-127.2.42.124:36407(127.2.42.124:36407)] disconnecting while in state READY
23:47:50.875 [DEBUG - main] (Connection.java:575) [peer master-127.2.42.125:42983(127.2.42.125:42983)] disconnecting while in state READY
23:47:50.876 [DEBUG - main] (Connection.java:575) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] disconnecting while in state READY
23:47:50.876 [DEBUG - main] (Connection.java:575) [peer master-127.2.42.126:45489(127.2.42.126:45489)] disconnecting while in state READY
23:47:50.876 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.42.124:36407(127.2.42.124:36407)] handling channelInactive
23:47:50.876 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] handling channelInactive
23:47:50.876 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.42.125:42983(127.2.42.125:42983)] handling channelInactive
23:47:50.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state READY due to: connection closed
23:47:50.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state READY due to: connection closed
23:47:50.877 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] handling channelInactive
23:47:50.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] cleaning up while in state READY due to: connection closed
23:47:50.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state READY due to: connection closed
23:47:50.878 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:50.879 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
23:47:50.879 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:47:50.879 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
23:47:50.879 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.42.126:45489(127.2.42.126:45489)] handling channelInactive
23:47:50.879 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state READY due to: connection closed
23:47:50.880 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
23:47:50.880 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
23:47:50.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.880667  2217 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2499
23:47:50.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:50.890661  2623 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:50.896 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table d39e0482339b468e842599b2c1b07a37
23:47:50.901 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 84f439a803514545aa7850275652b318 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
23:47:50.901 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:50.902 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:50.911 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6a861d85098215f67463640c100a3b8d1f538a5dc1c42edae6790e4f8c1e64ee'}]
23:47:50.911 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='665d2a2f91c4fb9dd85b216bbb5634c5696b3bb28cc158720ecd35b6a06cb2ce'}]
23:47:50.914 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:50.914 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:47:50.915 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:50.915 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299997, tablet=84f439a803514545aa7850275652b318@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257),7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)[L],b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}]
23:47:50.915 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:47:50.916 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299997, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}]
23:47:50.916 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:50.918 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] connecting to peer
23:47:50.920 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] Successfully connected to peer
23:47:50.931 [DEBUG - kudu-nio-0] (Connection.java:757) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] Successfully connected to peer
23:47:50.937 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.67
23:47:50.941 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.66
23:47:50.958 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:50.962 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:50.971 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcc2db931, L:/127.0.0.1:54280 - R:/127.2.42.66:39741] using SASL/PLAIN
23:47:50.972 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc17e5a87, L:/127.0.0.1:56226 - R:/127.2.42.67:34367] using SASL/PLAIN
23:47:50.985 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085218369536001) for scanner KuduScanner(table=replication_test_table, tablet=84f439a803514545aa7850275652b318, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:47:50.986 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [665d2a2f91c4fb9dd85b216bbb5634c5696b3bb28cc158720ecd35b6a06cb2ce]
23:47:50.986 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [665d2a2f91c4fb9dd85b216bbb5634c5696b3bb28cc158720ecd35b6a06cb2ce]
23:47:50.987 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:47:50.987 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:47:50.989 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] disconnecting while in state READY
23:47:50.991 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 665d2a2f91c4fb9dd85b216bbb5634c5696b3bb28cc158720ecd35b6a06cb2ce finished by subtask 0; deferring removal (restored in pending)
23:47:50.991 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:47:51.006 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] handling channelInactive
23:47:51.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state READY due to: connection closed
23:47:51.007 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:47:51.007 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:47:51.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.075948  2217 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2499
23:47:51.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.102356  2244 connection.cc:573] server connection from 127.2.42.65:51633 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:47:51.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.102771  2391 connection.cc:573] server connection from 127.2.42.65:53823 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:47:51.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.102993  2318 connection.cc:573] server connection from 127.2.42.65:37219 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:47:51.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.103524  2217 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2636
23:47:51.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.110687  2761 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:51.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468071167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:51.188 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job bbc34d76ac15add629743db00c4f4a33 (2252 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
23:47:51.191 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:47:51.191 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 665d2a2f91c4fb9dd85b216bbb5634c5696b3bb28cc158720ecd35b6a06cb2ce from pending
23:47:51.191 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 7 complete: removed 1 finished splits from enumerator state
23:47:51.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.277377  2789 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.42.65:39257: connect: Connection refused (error 111)
23:47:51.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.291801  2789 consensus_peers.cc:597] T 84f439a803514545aa7850275652b318 P 7a910d7b024e4df2993580f4f2923bb5 -> Peer 5166c0ced7204d998d8062d51526bfbd (127.2.42.65:39257): Couldn't send request to peer 5166c0ced7204d998d8062d51526bfbd. Status: Network error: Client connection negotiation failed: client connection to 127.2.42.65:39257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:47:51.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.314019  2217 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2636
23:47:51.342 [DEBUG - kudu-nio-0] (Connection.java:239) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] handling channelInactive
23:47:51.342 [DEBUG - kudu-nio-0] (Connection.java:709) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] cleaning up while in state READY due to: connection closed
23:47:51.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.342192  2217 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2773
23:47:51.342 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741) for tablet 37568e9b29014c3e9276b04109023ab5: connection closed
23:47:51.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.349381  2897 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:51.359 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] connecting to peer
23:47:51.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.362 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.379 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:51.382 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] Successfully connected to peer
23:47:51.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.543251  2217 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2773
23:47:51.545 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.67
23:47:51.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.579589  2217 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2228
23:47:51.579 [ERROR - kudu-nio-2] (Connection.java:452) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:47:51.580 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state NEGOTIATING due to: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367]
23:47:51.580 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367) for tablet 37568e9b29014c3e9276b04109023ab5: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367]
23:47:51.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.581013  2290 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:51.581 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] handling channelInactive
23:47:51.599 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:51.600 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:51.601 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.2.42.126:45489(127.2.42.126:45489)] Successfully connected to peer
23:47:51.602 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:51.603 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.2.42.125:42983(127.2.42.125:42983)] Successfully connected to peer
23:47:51.611 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.125
23:47:51.612 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.2.42.124:36407(127.2.42.124:36407)] Successfully connected to peer
23:47:51.623 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.42.124
23:47:51.627 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:51.632 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xf8212937, L:/127.0.0.1:57602 - R:/127.2.42.125:42983] using SASL/PLAIN
23:47:51.636 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:47:51.640 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x28724015, L:/127.0.0.1:49794 - R:/127.2.42.124:36407] using SASL/PLAIN
23:47:51.644 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:47:51.644 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29319, elapsed=45), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [36ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, deferred=null) after lookup
23:47:51.647 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:51.647 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:51.648 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=37568e9b29014c3e9276b04109023ab5, attempt=4, KuduRpc(method=Scan, tablet=37568e9b29014c3e9276b04109023ab5, attempt=4, TimeoutTracker(timeout=30000, elapsed=731), Traces: [0ms] sending RPC to server b12f0866b0104f9ebf76bdc0cd56d7e9, [425ms] received response from server b12f0866b0104f9ebf76bdc0cd56d7e9: Network error: connection closed, [426ms] delaying RPC due to: Network error: connection closed, [441ms] sending RPC to server 5166c0ced7204d998d8062d51526bfbd, [445ms] received response from server 5166c0ced7204d998d8062d51526bfbd: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [445ms] delaying RPC due to: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [462ms] sending RPC to server 7a910d7b024e4df2993580f4f2923bb5, [663ms] received response from server 7a910d7b024e4df2993580f4f2923bb5: Network error: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367], [663ms] delaying RPC due to: Network error: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367], [681ms] refreshing cache from master, [681ms] Sub RPC GetTableLocations: refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [717ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: OK, [726ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, [727ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [730ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, deferred=Deferred@1598196241(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup
23:47:51.649 [DEBUG - kudu-nio-5] (Connection.java:748) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] connecting to peer
23:47:51.651 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741
23:47:51.651 [DEBUG - kudu-nio-6] (Connection.java:709) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] cleaning up while in state CONNECTING due to: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741
23:47:51.651 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741
23:47:51.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468071667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:51.682 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:47:51.683 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
23:47:51.699 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] connecting to peer
23:47:51.701 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.701 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.724574  2217 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2228
23:47:51.739 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:51.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367
23:47:51.741 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367
23:47:51.741 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367
23:47:51.747 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.2.42.126:45489(127.2.42.126:45489)] handling channelInactive
23:47:51.747 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.42.126:45489(127.2.42.126:45489)] handling channelInactive
23:47:51.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state NEGOTIATING due to: connection closed
23:47:51.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state READY due to: connection closed
23:47:51.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.747516  2217 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2298
23:47:51.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: connection closed
23:47:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.749169  2362 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:51.782 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 37568e9b29014c3e9276b04109023ab5 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:47:51.782 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=37568e9b29014c3e9276b04109023ab5@[5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)[L],7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367),b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:47:51.783 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=37568e9b29014c3e9276b04109023ab5, attempt=8, KuduRpc(method=Scan, tablet=37568e9b29014c3e9276b04109023ab5, attempt=8, TimeoutTracker(timeout=30000, elapsed=865), Traces: [0ms] sending RPC to server b12f0866b0104f9ebf76bdc0cd56d7e9, [425ms] received response from server b12f0866b0104f9ebf76bdc0cd56d7e9: Network error: connection closed, [426ms] delaying RPC due to: Network error: connection closed, [441ms] sending RPC to server 5166c0ced7204d998d8062d51526bfbd, [445ms] received response from server 5166c0ced7204d998d8062d51526bfbd: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [445ms] delaying RPC due to: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [462ms] sending RPC to server 7a910d7b024e4df2993580f4f2923bb5, [663ms] received response from server 7a910d7b024e4df2993580f4f2923bb5: Network error: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367], [663ms] delaying RPC due to: Network error: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367], [681ms] refreshing cache from master, [681ms] Sub RPC GetTableLocations: refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [717ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: OK, [726ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, [727ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [730ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, [731ms] sending RPC to server b12f0866b0104f9ebf76bdc0cd56d7e9, [734ms] received response from server b12f0866b0104f9ebf76bdc0cd56d7e9: Network error: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741, [734ms] delaying RPC due to: Network error: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741, [782ms] sending RPC to server 5166c0ced7204d998d8062d51526bfbd, [784ms] received response from server 5166c0ced7204d998d8062d51526bfbd: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [784ms] delaying RPC due to: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [822ms] sending RPC to server 7a910d7b024e4df2993580f4f2923bb5, [824ms] received response from server 7a910d7b024e4df2993580f4f2923bb5: Network error: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367, [824ms] delaying RPC due to: Network error: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367, [861ms] refreshing cache from master, [861ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [864ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, deferred=Deferred@1598196241(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@566100826 after retry RPC@1479309314), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@566100826 after retry RPC@1479309314)))) after lookup
23:47:51.783 [DEBUG - kudu-nio-5] (Connection.java:748) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] connecting to peer
23:47:51.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741
23:47:51.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] cleaning up while in state CONNECTING due to: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741
23:47:51.784 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741
23:47:51.859 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] connecting to peer
23:47:51.860 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.860 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.860 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257
23:47:51.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.864995  2217 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2298
23:47:51.889 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.2.42.125:42983(127.2.42.125:42983)] handling channelInactive
23:47:51.889 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state READY due to: connection closed
23:47:51.889 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.42.125:42983(127.2.42.125:42983)] handling channelInactive
23:47:51.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state READY due to: connection closed
23:47:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.889351  2391 connection.cc:573] client connection to 127.2.42.125:42983 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:47:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:51.890188  2391 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:47:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.891665  2217 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 2369
23:47:51.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:51.893621  2434 generic_service.cc:196] Checking for leaks (request via RPC)
23:47:52.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:52.025561  2217 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 2369
23:47:52.044 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.2.42.124:36407(127.2.42.124:36407)] handling channelInactive
23:47:52.044 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.42.124:36407(127.2.42.124:36407)] handling channelInactive
23:47:52.044 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state READY due to: connection closed
23:47:52.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state READY due to: connection closed
23:47:52.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:52Z chronyd exiting
23:47:52.139 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] connecting to peer
23:47:52.140 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367
23:47:52.140 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367
23:47:52.140 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367) for tablet 37568e9b29014c3e9276b04109023ab5: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367
23:47:52.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468072167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:52.188 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
23:47:52.190 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
.23:47:52.191 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468072191
23:47:52.191 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468072191
23:47:52.198 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.200 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.200 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.200 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location master-127.2.42.124:36407(127.2.42.124:36407) for tablet Kudu Master: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.206 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:47:52.211 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:47:52.211 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:47:52.211 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:47:52.211 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:47:52.212 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:47:52.214 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:47:52.219 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.220 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.220 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.220 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.220 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.224 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.238 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.239 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.240 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.240 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.240 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.240 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.241 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.241 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.241 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.258 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.259 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.260 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.261 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.279 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.280 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.281 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.282 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.318 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.319 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.320 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.320 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.320 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.320 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.321 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.321 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.321 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.321 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.321 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.321 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.322 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.339 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.339 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.340 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.341 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.341 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.342 [INFO - pool-30-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.342 [WARN - pool-30-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.418 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.420 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.420 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.421 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.421 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.421 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.421 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.422 [INFO - pool-30-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.423 [WARN - pool-30-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.479 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.480 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.481 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.481 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.482 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.483 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468072667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:52.685 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
23:47:52.687 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
23:47:52.731 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:52.732 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:47:52.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:52.734752  3995 mini_oidc.cc:150] Starting JWKS server
23:47:52.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:52.737305  3995 webserver.cc:534] Webserver started at http://127.0.0.1:44541/ using document root <none> and password file <none>
23:47:52.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:52.737545  3995 mini_oidc.cc:186] Starting OIDC Discovery server
23:47:52.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:52.738133  3995 webserver.cc:534] Webserver started at http://127.0.0.1:32789/ using document root <none> and password file <none>
23:47:52.798 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:52.799 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:52.800 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.800 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.800 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:52.800 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:52.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:52.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.801 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:52.801 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:52.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:52Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:47:52.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:52Z Disabled control of system clock
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:52.817341  3995 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/logs
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data/info.pb
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.254:44025
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.254
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:52.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:52.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:52.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44541/jwks.json with env {}
23:47:53.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468073167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.177677  4007 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.178213  4007 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.178388  4007 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:53.182 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:47:53.184 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
23:47:53.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.191365  4007 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:53.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.191471  4007 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:53.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.191531  4007 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:53.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.191577  4007 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:53.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.191635  4007 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:53.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.191715  4007 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44541/jwks.json
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.204084  4007 master_runner.cc:387] Master server non-default flags:
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.254:44025
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44541/jwks.json
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data/info.pb
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.254
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/logs
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:53.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.206205  4007 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:53.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.208537  4007 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:53.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.218257  4012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:53.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.219235  4013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:53.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.223436  4015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:53.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.223559  4007 server_base.cc:1061] running on GCE node
23:47:53.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.224490  4007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:53.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.226190  4007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:53.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.227454  4007 hybrid_clock.cc:648] HybridClock initialized: now 1783468073227381 us; error 63 us; skew 500 ppm
23:47:53.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.228022  4007 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:53.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.231734  4007 webserver.cc:534] Webserver started at http://127.3.230.254:34243/ using document root <none> and password file <none>
23:47:53.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.232618  4007 fs_manager.cc:362] Metadata directory not provided
23:47:53.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.232769  4007 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:53.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.233192  4007 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:53.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.235924  4007 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data/instance:
23:47:53.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a58c916423f429185c32aeeb123188f"
23:47:53.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:53 on dist-test-slave-hfsf"
23:47:53.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.236835  4007 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal/instance:
23:47:53.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a58c916423f429185c32aeeb123188f"
23:47:53.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:53 on dist-test-slave-hfsf"
23:47:53.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.242939  4007 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
23:47:53.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.246950  4021 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:53.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.248450  4007 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:47:53.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.248646  4007 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a58c916423f429185c32aeeb123188f"
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:53 on dist-test-slave-hfsf"
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.248966  4007 fs_report.cc:389] FS layout report
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data/data
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:53.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.275729  4007 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:53.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.276803  4007 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:53.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.277213  4007 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:53.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.300679  4007 rpc_server.cc:307] RPC server started. Bound to: 127.3.230.254:44025
23:47:53.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.300715  4073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.230.254:44025 every 8 connection(s)
23:47:53.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.302445  4007 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/data/info.pb
23:47:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.307487  4074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.307960  3995 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4007
23:47:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.308300  3995 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-0/wal/instance
23:47:53.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.311532  3995 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:53.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:53.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/logs
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data/info.pb
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.253:41003
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.253
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44541/jwks.json with env {}
23:47:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.316932  4074 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } has no permanent_uuid. Determining permanent_uuid...
23:47:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.352221  4074 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } has no permanent_uuid. Determining permanent_uuid...
23:47:53.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.353499  4025 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.230.253:41003: connect: Connection refused (error 111)
23:47:53.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.355417  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.253:41003: Network error: Client connection negotiation failed: client connection to 127.3.230.253:41003: connect: Connection refused (error 111)
23:47:53.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.404848  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } attempt: 1
23:47:53.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.407238  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.253:41003: Network error: Client connection negotiation failed: client connection to 127.3.230.253:41003: connect: Connection refused (error 111)
23:47:53.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.475584  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } attempt: 2
23:47:53.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.478080  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.253:41003: Network error: Client connection negotiation failed: client connection to 127.3.230.253:41003: connect: Connection refused (error 111)
23:47:53.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.569433  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } attempt: 3
23:47:53.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.571676  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.253:41003: Network error: Client connection negotiation failed: client connection to 127.3.230.253:41003: connect: Connection refused (error 111)
23:47:53.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468073667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:53.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.678722  4076 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:53.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.679483  4076 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:53.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.679776  4076 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:53.683 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:47:53.684 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
23:47:53.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.691213  4076 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:53.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.691318  4076 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:53.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.691375  4076 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:53.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.691414  4076 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:53.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.691466  4076 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:53.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.691500  4076 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44541/jwks.json
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.702129  4076 master_runner.cc:387] Master server non-default flags:
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.253:41003
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44541/jwks.json
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data/info.pb
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.253
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/logs
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:53.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.703948  4076 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:53.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.705924  4076 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:53.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.714931  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } attempt: 4
23:47:53.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.715162  4084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:53.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.715335  4085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:53.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.716503  4087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:53.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.716933  4076 server_base.cc:1061] running on GCE node
23:47:53.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.717819  4076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:53.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.718843  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.253:41003: Network error: Client connection negotiation failed: client connection to 127.3.230.253:41003: connect: Connection refused (error 111)
23:47:53.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.719583  4076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:53.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.720860  4076 hybrid_clock.cc:648] HybridClock initialized: now 1783468073720800 us; error 39 us; skew 500 ppm
23:47:53.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.721350  4076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:53.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.724411  4076 webserver.cc:534] Webserver started at http://127.3.230.253:39019/ using document root <none> and password file <none>
23:47:53.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.725395  4076 fs_manager.cc:362] Metadata directory not provided
23:47:53.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.725561  4076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:53.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.726246  4076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:53.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.729029  4076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data/instance:
23:47:53.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7dbac1f8385f4619a94d467bd10d2cce"
23:47:53.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:53 on dist-test-slave-hfsf"
23:47:53.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.729948  4076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal/instance:
23:47:53.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7dbac1f8385f4619a94d467bd10d2cce"
23:47:53.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:53 on dist-test-slave-hfsf"
23:47:53.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.736166  4076 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
23:47:53.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.740203  4094 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:53.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.741705  4076 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.741945  4076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7dbac1f8385f4619a94d467bd10d2cce"
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:53 on dist-test-slave-hfsf"
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.742203  4076 fs_report.cc:389] FS layout report
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data/data
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:53.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:53.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:53.759 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:53.760 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:53.760 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:53.760 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:53.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:53.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:53.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:53.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:53.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:53.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:53.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:53.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:53.761 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:53.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.787278  4076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:53.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.788340  4076 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:53.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.788700  4076 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:53.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.812251  4076 rpc_server.cc:307] RPC server started. Bound to: 127.3.230.253:41003
23:47:53.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.812290  4145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.230.253:41003 every 8 connection(s)
23:47:53.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.813949  4076 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/data/info.pb
23:47:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.816265  3995 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4076
23:47:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.816416  3995 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-1/wal/instance
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.817557  3995 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/logs
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data/info.pb
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.252:37691
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.252
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:53.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44541/jwks.json with env {}
23:47:53.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.819576  4146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:53.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.827136  4146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } has no permanent_uuid. Determining permanent_uuid...
23:47:53.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.842152  4146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } has no permanent_uuid. Determining permanent_uuid...
23:47:53.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.853302  4146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } has no permanent_uuid. Determining permanent_uuid...
23:47:53.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.854655  4096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:53.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.856812  4146 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:53.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.906162  4146 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 1
23:47:53.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.908566  4146 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:53.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:53.976866  4146 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 2
23:47:53.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:53.979492  4146 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.018133  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } attempt: 5
23:47:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.025974  4074 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } has no permanent_uuid. Determining permanent_uuid...
23:47:54.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.028169  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.070798  4146 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 3
23:47:54.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.073405  4146 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.079432  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 1
23:47:54.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.082283  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.150578  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 2
23:47:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.153195  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468074167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:54.183 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:47:54.185 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
23:47:54.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.193835  4148 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:54.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.194231  4148 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:54.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.194417  4148 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:54.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.203490  4148 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:54.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.203639  4148 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:54.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.203722  4148 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:54.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.203790  4148 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:54.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.203873  4148 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:54.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.203926  4148 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44541/jwks.json
23:47:54.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.214587  4148 master_runner.cc:387] Master server non-default flags:
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.252:37691
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44541/jwks.json
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data/info.pb
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.252
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/logs
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:54.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:54.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:54.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:54.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:54.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:54.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:54.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.216672  4146 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 4
23:47:54.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.216794  4148 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:54.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.219080  4148 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:54.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.219149  4146 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.227906  4157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:54.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.228011  4156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:54.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.227994  4159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:54.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.229015  4148 server_base.cc:1061] running on GCE node
23:47:54.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.229897  4148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:54.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.231832  4148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:54.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.233111  4148 hybrid_clock.cc:648] HybridClock initialized: now 1783468074233029 us; error 65 us; skew 500 ppm
23:47:54.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.233563  4148 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:54.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.236292  4148 webserver.cc:534] Webserver started at http://127.3.230.252:46515/ using document root <none> and password file <none>
23:47:54.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.237159  4148 fs_manager.cc:362] Metadata directory not provided
23:47:54.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.237298  4148 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:54.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.237694  4148 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:54.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.240330  4148 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data/instance:
23:47:54.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "13e60c13f07040039fcefc22abd99ba5"
23:47:54.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:54 on dist-test-slave-hfsf"
23:47:54.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.241232  4148 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal/instance:
23:47:54.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "13e60c13f07040039fcefc22abd99ba5"
23:47:54.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:54 on dist-test-slave-hfsf"
23:47:54.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.247278  4148 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
23:47:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.251551  4165 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.253157  4148 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:47:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.253386  4148 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal
23:47:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "13e60c13f07040039fcefc22abd99ba5"
23:47:54.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:54 on dist-test-slave-hfsf"
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.253705  4148 fs_report.cc:389] FS layout report
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data/data
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:54.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.259454  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 3
23:47:54.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.261622  4074 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.230.252:37691: Network error: Client connection negotiation failed: client connection to 127.3.230.252:37691: connect: Connection refused (error 111)
23:47:54.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.279109  4148 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:54.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.280377  4148 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:54.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.280654  4148 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:54.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.305115  4148 rpc_server.cc:307] RPC server started. Bound to: 127.3.230.252:37691
23:47:54.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.305147  4217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.230.252:37691 every 8 connection(s)
23:47:54.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.307060  4148 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/data/info.pb
23:47:54.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.307969  3995 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4148
23:47:54.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.308238  3995 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/master-2/wal/instance
23:47:54.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.312729  4218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:54.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.321365  4218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } has no permanent_uuid. Determining permanent_uuid...
23:47:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.337916  4218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } has no permanent_uuid. Determining permanent_uuid...
23:47:54.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.344534  4218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } has no permanent_uuid. Determining permanent_uuid...
23:47:54.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.356449  4218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: Bootstrap starting.
23:47:54.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.360472  4218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: Neither blocks nor log segments found. Creating new log.
23:47:54.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.361738  4218 log.cc:826] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: Log is configured to *not* fsync() on all Append() calls
23:47:54.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.364867  4218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: No bootstrap required, opened a new log
23:47:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.370752  4218 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.371161  4218 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.371304  4218 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13e60c13f07040039fcefc22abd99ba5, State: Initialized, Role: FOLLOWER
23:47:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.372159  4218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.373497  4225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.373824  4225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.374735  4218 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: configured and running, proceeding with master startup.
23:47:54.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.385939  4236 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:54.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.386118  4236 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:54.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.382894  4148 master_runner.cc:187] Error getting master registration for 127.3.230.254:44025: OK, instance_id { permanent_uuid: "6a58c916423f429185c32aeeb123188f" instance_seqno: 1783468073294495 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:54.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.390695  4148 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:54.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.391274  4225 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:54.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.391615  4225 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.393190  4225 leader_election.cc:290] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a58c916423f429185c32aeeb123188f (127.3.230.254:44025), 7dbac1f8385f4619a94d467bd10d2cce (127.3.230.253:41003)
23:47:54.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.438905  4074 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 4
23:47:54.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.452489  4074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: Bootstrap starting.
23:47:54.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.456928  4074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: Neither blocks nor log segments found. Creating new log.
23:47:54.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.458500  4074 log.cc:826] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: Log is configured to *not* fsync() on all Append() calls
23:47:54.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.469020  4074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: No bootstrap required, opened a new log
23:47:54.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.476866  4074 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.477265  4074 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:54.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.477394  4074 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a58c916423f429185c32aeeb123188f, State: Initialized, Role: FOLLOWER
23:47:54.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.478154  4074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.482839  4239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.484150  4074 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: configured and running, proceeding with master startup.
23:47:54.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.486984  4048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13e60c13f07040039fcefc22abd99ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a58c916423f429185c32aeeb123188f" is_pre_election: true
23:47:54.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.487704  4048 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13e60c13f07040039fcefc22abd99ba5 in term 0.
23:47:54.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.488845  4169 leader_election.cc:304] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e60c13f07040039fcefc22abd99ba5, 6a58c916423f429185c32aeeb123188f; no voters: 
23:47:54.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.489498  4225 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:54.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.489693  4225 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:54.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.489830  4225 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 0 FOLLOWER]: Advancing to term 1
23:47:54.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.494552  4225 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.505275  4048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13e60c13f07040039fcefc22abd99ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a58c916423f429185c32aeeb123188f"
23:47:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.505646  4048 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 0 FOLLOWER]: Advancing to term 1
23:47:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.508599  4225 leader_election.cc:290] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a58c916423f429185c32aeeb123188f (127.3.230.254:44025), 7dbac1f8385f4619a94d467bd10d2cce (127.3.230.253:41003)
23:47:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.510571  4239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.512054  4048 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e60c13f07040039fcefc22abd99ba5 in term 1.
23:47:54.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.512838  4169 leader_election.cc:304] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13e60c13f07040039fcefc22abd99ba5, 6a58c916423f429185c32aeeb123188f; no voters: 
23:47:54.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.513285  4225 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 1 FOLLOWER]: Leader election won for term 1
23:47:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.513998  4225 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [term 1 LEADER]: Becoming Leader. State: Replica: 13e60c13f07040039fcefc22abd99ba5, State: Running, Role: LEADER
23:47:54.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.514693  4225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.518379  4146 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } attempt: 5
23:47:54.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.530568  4027 tablet.cc:2406] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:54.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.532855  4171 tablet.cc:2406] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:54.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.520206  4007 master_runner.cc:187] Error getting master registration for 127.3.230.253:41003: OK, instance_id { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" instance_seqno: 1783468073806009 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:54.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.537312  4146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: Bootstrap starting.
23:47:54.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.540542  4007 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:54.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.541389  4251 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:54.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.541548  4247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13e60c13f07040039fcefc22abd99ba5. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.541929  4247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: This master's current role is: LEADER
23:47:54.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.542708  4146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: Neither blocks nor log segments found. Creating new log.
23:47:54.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.542999  4251 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:54.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.544152  4146 log.cc:826] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: Log is configured to *not* fsync() on all Append() calls
23:47:54.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.554832  4254 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:47:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.557720  4254 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:47:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.558310  4146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: No bootstrap required, opened a new log
23:47:54.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.572853  4146 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.573551  4146 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.573822  4146 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbac1f8385f4619a94d467bd10d2cce, State: Initialized, Role: FOLLOWER
23:47:54.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.575306  4146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } }
23:47:54.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.578913  4048 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [term 1 FOLLOWER]: Refusing update from remote peer 13e60c13f07040039fcefc22abd99ba5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:54.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.580463  4247 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:54.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.587507  4257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.587878  4257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.590991  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13e60c13f07040039fcefc22abd99ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbac1f8385f4619a94d467bd10d2cce"
23:47:54.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.591441  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13e60c13f07040039fcefc22abd99ba5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbac1f8385f4619a94d467bd10d2cce" is_pre_election: true
23:47:54.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.592388  4120 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [term 0 FOLLOWER]: Advancing to term 1
23:47:54.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.598120  4120 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13e60c13f07040039fcefc22abd99ba5 in term 1.
23:47:54.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.599035  4119 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [term 1 FOLLOWER]: Refusing update from remote peer 13e60c13f07040039fcefc22abd99ba5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:54.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.600494  4247 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:54.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.606628  4146 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: configured and running, proceeding with master startup.
23:47:54.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.617468  4257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13e60c13f07040039fcefc22abd99ba5. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.617826  4257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.620448  4239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13e60c13f07040039fcefc22abd99ba5. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.620736  4239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.620656  4256 mvcc.cc:204] Tried to move back new op lower bound from 7305085233458720768 to 7305085233219444736. Current Snapshot: MvccSnapshot[applied={T|T < 7305085233458720768}]
23:47:54.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.621799  4247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.621989  4247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: This master's current role is: LEADER
23:47:54.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.624531  4247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.624795  4247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5 [sys.catalog]: This master's current role is: LEADER
23:47:54.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.627506  4257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.627736  4257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.625984  4258 mvcc.cc:204] Tried to move back new op lower bound from 7305085233458720768 to 7305085233219444736. Current Snapshot: MvccSnapshot[applied={T|T < 7305085233458720768}]
23:47:54.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.629501  4254 catalog_manager.cc:1382] Generated new cluster ID: 6de3b48cae5c4b56a9f489a3a086d7e3
23:47:54.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.629624  4254 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:47:54.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.632767  4239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "13e60c13f07040039fcefc22abd99ba5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a58c916423f429185c32aeeb123188f" member_type: VOTER last_known_addr { host: "127.3.230.254" port: 44025 } } peers { permanent_uuid: "7dbac1f8385f4619a94d467bd10d2cce" member_type: VOTER last_known_addr { host: "127.3.230.253" port: 41003 } } peers { permanent_uuid: "13e60c13f07040039fcefc22abd99ba5" member_type: VOTER last_known_addr { host: "127.3.230.252" port: 37691 } } }
23:47:54.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.633006  4239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f [sys.catalog]: This master's current role is: FOLLOWER
23:47:54.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.657516  4276 catalog_manager.cc:1294] Loaded cluster ID: 6de3b48cae5c4b56a9f489a3a086d7e3
23:47:54.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.657966  4276 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: loading cluster ID for follower catalog manager: success
23:47:54.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.659547  4276 catalog_manager.cc:1611] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: acquiring CA information for follower catalog manager: Not found: root CA entry not found
23:47:54.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:54.659894  4276 catalog_manager.cc:883] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
23:47:54.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468074667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:54.697 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=29 ms, finalizationTime=0 ms).
23:47:54.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.696297  4254 catalog_manager.cc:1405] Generated new certificate authority record
23:47:54.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.698113  4254 catalog_manager.cc:1539] Loading token signing keys...
23:47:54.700 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
23:47:54.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.719203  4254 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 13e60c13f07040039fcefc22abd99ba5: Generated new TSK 0
23:47:54.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.720867  4254 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:47:54.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:54.730528  3995 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/logs
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data/info.pb
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.193:0
23:47:54.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.230.193
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.193
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:54.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:55.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468075167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:55.182 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:47:55.184 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
23:47:55.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.311268  4278 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:55.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.311761  4278 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:55.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.311900  4278 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:55.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.325708  4278 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:55.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.326275  4278 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.230.193
23:47:55.338 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:55.339 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:55.339 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:55.339 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:55.340 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:55.340 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:55.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:55.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:55.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.340672  4278 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.193:0
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data/info.pb
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.193
23:47:55.341 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:55.341 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:55.341 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.230.193
23:47:55.341 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/logs
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:55.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.342955  4278 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:55.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.344921  4278 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:55.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.355517  4285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:55.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.355544  4284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:55.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.356449  4287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:55.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.356806  4278 server_base.cc:1061] running on GCE node
23:47:55.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.357398  4278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:55.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.358489  4278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:55.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.359704  4278 hybrid_clock.cc:648] HybridClock initialized: now 1783468075359591 us; error 105 us; skew 500 ppm
23:47:55.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.360174  4278 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:55.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.362644  4278 webserver.cc:534] Webserver started at http://127.3.230.193:40515/ using document root <none> and password file <none>
23:47:55.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.363547  4278 fs_manager.cc:362] Metadata directory not provided
23:47:55.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.363695  4278 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:55.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.364100  4278 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:55.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.366797  4278 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data/instance:
23:47:55.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c56332fbfac479b9424d32d20cd3a19"
23:47:55.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:55 on dist-test-slave-hfsf"
23:47:55.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.367792  4278 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal/instance:
23:47:55.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c56332fbfac479b9424d32d20cd3a19"
23:47:55.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:55 on dist-test-slave-hfsf"
23:47:55.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.373826  4278 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:47:55.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.378175  4293 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.379946  4278 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.380164  4278 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c56332fbfac479b9424d32d20cd3a19"
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:55 on dist-test-slave-hfsf"
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.380465  4278 fs_report.cc:389] FS layout report
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data/data
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:55.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:55.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:55.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.425582  4278 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:55.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.426640  4278 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:55.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.427050  4278 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:55.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.428232  4278 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:55.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.430158  4278 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:55.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.430287  4278 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:55.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.430397  4278 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:55.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.430480  4278 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.466696  4278 rpc_server.cc:307] RPC server started. Bound to: 127.3.230.193:42511
23:47:55.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.466746  4406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.230.193:42511 every 8 connection(s)
23:47:55.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.468374  4278 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/data/info.pb
23:47:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.470871  3995 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4278
23:47:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.471089  3995 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-0/wal/instance
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.476056  3995 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/logs
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data/info.pb
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.194:0
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.230.194
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.194
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:55.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:55.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.491988  4407 heartbeater.cc:344] Connected to a master server at 127.3.230.252:37691
23:47:55.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.492147  4408 heartbeater.cc:344] Connected to a master server at 127.3.230.254:44025
23:47:55.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.492481  4408 heartbeater.cc:461] Registering TS with master...
23:47:55.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.492481  4407 heartbeater.cc:461] Registering TS with master...
23:47:55.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.493865  4408 heartbeater.cc:507] Master 127.3.230.254:44025 requested a full tablet report, sending...
23:47:55.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.495162  4407 heartbeater.cc:507] Master 127.3.230.252:37691 requested a full tablet report, sending...
23:47:55.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.497618  4183 ts_manager.cc:194] Registered new tserver with Master: 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511)
23:47:55.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.497824  4037 ts_manager.cc:194] Registered new tserver with Master: 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511)
23:47:55.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.500082  4183 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.230.193:35875
23:47:55.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.500784  4409 heartbeater.cc:344] Connected to a master server at 127.3.230.253:41003
23:47:55.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.501098  4409 heartbeater.cc:461] Registering TS with master...
23:47:55.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.501746  4409 heartbeater.cc:507] Master 127.3.230.253:41003 requested a full tablet report, sending...
23:47:55.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.503860  4111 ts_manager.cc:194] Registered new tserver with Master: 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511)
23:47:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.545392  4251 catalog_manager.cc:1294] Loaded cluster ID: 6de3b48cae5c4b56a9f489a3a086d7e3
23:47:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.545521  4251 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: loading cluster ID for follower catalog manager: success
23:47:55.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.549299  4251 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: acquiring CA information for follower catalog manager: success
23:47:55.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.551849  4251 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6a58c916423f429185c32aeeb123188f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:55.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.663779  4276 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: acquiring CA information for follower catalog manager: success
23:47:55.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.665844  4276 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7dbac1f8385f4619a94d467bd10d2cce: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:55.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468075667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:55.686 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
23:47:55.687 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
23:47:55.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.861686  4417 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:55.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.862124  4417 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:55.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.862252  4417 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:55.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.871419  4417 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:55.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.871680  4417 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.230.194
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.883133  4417 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.194:0
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data/info.pb
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.194
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.230.194
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/logs
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:55.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.885336  4417 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:55.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.887609  4417 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:55.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.901759  4426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:55.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.901654  4423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:55.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:55.901646  4424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:55.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.903050  4417 server_base.cc:1061] running on GCE node
23:47:55.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.903720  4417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:55.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.904866  4417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:55.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.906126  4417 hybrid_clock.cc:648] HybridClock initialized: now 1783468075906060 us; error 70 us; skew 500 ppm
23:47:55.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.906472  4417 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.909209  4417 webserver.cc:534] Webserver started at http://127.3.230.194:34701/ using document root <none> and password file <none>
23:47:55.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.910085  4417 fs_manager.cc:362] Metadata directory not provided
23:47:55.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.910185  4417 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:55.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.910568  4417 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:55.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.913584  4417 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data/instance:
23:47:55.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9460cad6b24b4916b63842f2742139a2"
23:47:55.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:55 on dist-test-slave-hfsf"
23:47:55.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.914444  4417 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal/instance:
23:47:55.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9460cad6b24b4916b63842f2742139a2"
23:47:55.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:55 on dist-test-slave-hfsf"
23:47:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.921010  4417 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.001s
23:47:55.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.925037  4432 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.926750  4417 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.927105  4417 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9460cad6b24b4916b63842f2742139a2"
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:55 on dist-test-slave-hfsf"
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.927330  4417 fs_report.cc:389] FS layout report
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data/data
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:55.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.971215  4417 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:55.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.972188  4417 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:55.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.972447  4417 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:55.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.973493  4417 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:55.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.975463  4417 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:55.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.975562  4417 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:55.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.975641  4417 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:55.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:55.975687  4417 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:56.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.022678  4417 rpc_server.cc:307] RPC server started. Bound to: 127.3.230.194:45625
23:47:56.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.022794  4545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.230.194:45625 every 8 connection(s)
23:47:56.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.024380  4417 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/data/info.pb
23:47:56.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.032081  3995 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4417
23:47:56.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.032322  3995 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-1/wal/instance
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.038029  3995 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/logs
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data/info.pb
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.195:0
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.230.195
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.195
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:56.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.045323  4547 heartbeater.cc:344] Connected to a master server at 127.3.230.254:44025
23:47:56.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.045898  4546 heartbeater.cc:344] Connected to a master server at 127.3.230.252:37691
23:47:56.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.046061  4546 heartbeater.cc:461] Registering TS with master...
23:47:56.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.045899  4547 heartbeater.cc:461] Registering TS with master...
23:47:56.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.047412  4546 heartbeater.cc:507] Master 127.3.230.252:37691 requested a full tablet report, sending...
23:47:56.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.047529  4547 heartbeater.cc:507] Master 127.3.230.254:44025 requested a full tablet report, sending...
23:47:56.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.049401  4183 ts_manager.cc:194] Registered new tserver with Master: 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:47:56.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.049482  4037 ts_manager.cc:194] Registered new tserver with Master: 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:47:56.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.050225  4548 heartbeater.cc:344] Connected to a master server at 127.3.230.253:41003
23:47:56.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.050400  4548 heartbeater.cc:461] Registering TS with master...
23:47:56.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.050454  4183 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.230.194:53353
23:47:56.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.051054  4548 heartbeater.cc:507] Master 127.3.230.253:41003 requested a full tablet report, sending...
23:47:56.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.052367  4111 ts_manager.cc:194] Registered new tserver with Master: 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:47:56.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468076167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:56.265 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=97 ms, finalizationTime=1 ms).
23:47:56.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
23:47:56.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.434881  4556 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:56.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.435382  4556 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:56.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.435508  4556 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:56.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.444603  4556 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.444842  4556 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.230.195
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.456066  4556 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.230.212:41315
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.230.195:0
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data/info.pb
23:47:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.230.195
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.230.254:44025,127.3.230.253:41003,127.3.230.252:37691
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.230.195
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/logs
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:56.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.458228  4556 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:56.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.460376  4556 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:56.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.474619  4561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:56.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.476402  4562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:56.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:56.477909  4564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:56.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.478583  4556 server_base.cc:1061] running on GCE node
23:47:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.479496  4556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:56.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.480818  4556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:56.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.482086  4556 hybrid_clock.cc:648] HybridClock initialized: now 1783468076482020 us; error 65 us; skew 500 ppm
23:47:56.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.482561  4556 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:56.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.485157  4556 webserver.cc:534] Webserver started at http://127.3.230.195:46469/ using document root <none> and password file <none>
23:47:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.486150  4556 fs_manager.cc:362] Metadata directory not provided
23:47:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.486302  4556 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.486737  4556 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.489584  4556 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data/instance:
23:47:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8d19df80ee04424f9dfce1f351ce4189"
23:47:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:56 on dist-test-slave-hfsf"
23:47:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.490540  4556 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal/instance:
23:47:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8d19df80ee04424f9dfce1f351ce4189"
23:47:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:56 on dist-test-slave-hfsf"
23:47:56.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.497473  4556 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:47:56.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.502332  4570 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.503906  4407 heartbeater.cc:499] Master 127.3.230.252:37691 was elected leader, sending a full tablet report...
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.504163  4556 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.504307  4556 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8d19df80ee04424f9dfce1f351ce4189"
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:56 on dist-test-slave-hfsf"
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.504586  4556 fs_report.cc:389] FS layout report
23:47:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data/data
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:56.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:56.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.532755  4556 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:56.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.533780  4556 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:56.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.534035  4556 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:56.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.535262  4556 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:56.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.537041  4556 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:56.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.537180  4556 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:56.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.537295  4556 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:56.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.537372  4556 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:56.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.576118  4556 rpc_server.cc:307] RPC server started. Bound to: 127.3.230.195:35473
23:47:56.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.576165  4684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.230.195:35473 every 8 connection(s)
23:47:56.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.577837  4556 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/data/info.pb
23:47:56.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.585929  3995 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4556
23:47:56.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.586140  3995 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster424484845998302284/ts-2/wal/instance
23:47:56.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.601500  4687 heartbeater.cc:344] Connected to a master server at 127.3.230.253:41003
23:47:56.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.601977  4687 heartbeater.cc:461] Registering TS with master...
23:47:56.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.603269  4687 heartbeater.cc:507] Master 127.3.230.253:41003 requested a full tablet report, sending...
23:47:56.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.605270  4111 ts_manager.cc:194] Registered new tserver with Master: 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:47:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.607406  4686 heartbeater.cc:344] Connected to a master server at 127.3.230.254:44025
23:47:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.607627  4685 heartbeater.cc:344] Connected to a master server at 127.3.230.252:37691
23:47:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.607620  4686 heartbeater.cc:461] Registering TS with master...
23:47:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.607800  4685 heartbeater.cc:461] Registering TS with master...
23:47:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.608214  4686 heartbeater.cc:507] Master 127.3.230.254:44025 requested a full tablet report, sending...
23:47:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.608467  4685 heartbeater.cc:507] Master 127.3.230.252:37691 requested a full tablet report, sending...
23:47:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.609490  4183 ts_manager.cc:194] Registered new tserver with Master: 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:47:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.609498  4037 ts_manager.cc:194] Registered new tserver with Master: 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:47:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.610512  4183 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.230.195:45987
23:47:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:56.621351  3995 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:47:56.623 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:56.623 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:47:56.625 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.230.254"
      port: 44025
    }
    bound_http_address {
      host: "127.3.230.254"
      port: 34243
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.230.253"
      port: 41003
    }
    bound_http_address {
      host: "127.3.230.253"
      port: 39019
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.230.252"
      port: 37691
    }
    bound_http_address {
      host: "127.3.230.252"
      port: 46515
    }
  }
}

23:47:56.626 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:47:56.630 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.230.193"
      port: 42511
    }
    bound_http_address {
      host: "127.3.230.193"
      port: 40515
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.230.194"
      port: 45625
    }
    bound_http_address {
      host: "127.3.230.194"
      port: 34701
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.230.195"
      port: 35473
    }
    bound_http_address {
      host: "127.3.230.195"
      port: 46469
    }
  }
}

23:47:56.630 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:47:56.633 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:47:56.633 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:47:56.633 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:47:56.633 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:47:56.634 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:47:56.637 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:47:56.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468076667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:56.680 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:47:56.682 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
23:47:57.009 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:47:57.009 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:47:57.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.012596  4695 mini_oidc.cc:150] Starting JWKS server
23:47:57.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.015060  4695 webserver.cc:534] Webserver started at http://127.0.0.1:46269/ using document root <none> and password file <none>
23:47:57.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.015292  4695 mini_oidc.cc:186] Starting OIDC Discovery server
23:47:57.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.015897  4695 webserver.cc:534] Webserver started at http://127.0.0.1:33629/ using document root <none> and password file <none>
23:47:57.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:57Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:47:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:47:57Z Disabled control of system clock
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.045233  4695 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/logs
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data/info.pb
23:47:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.254:41393
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.254
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:57.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46269/jwks.json with env {}
23:47:57.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.054055  4546 heartbeater.cc:499] Master 127.3.230.252:37691 was elected leader, sending a full tablet report...
23:47:57.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468077167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:57.183 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:47:57.185 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
23:47:57.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.415539  4706 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:57.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.415931  4706 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:57.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.416064  4706 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.424981  4706 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.425100  4706 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.425180  4706 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.425221  4706 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.425276  4706 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.425311  4706 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46269/jwks.json
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.436367  4706 master_runner.cc:387] Master server non-default flags:
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.254:41393
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46269/jwks.json
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data/info.pb
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.254
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/logs
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:57.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:57.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.438376  4706 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:57.439 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:57.440 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:57.440 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:57.440 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:57.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:57.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:57.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.441085  4706 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:57.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:57.441 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:57.441 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:57.441 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:57.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:57.441 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:57.443 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:57.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.451907  4711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:57.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.451917  4712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:57.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.453397  4714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:57.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.454774  4706 server_base.cc:1061] running on GCE node
23:47:57.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.455855  4706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:57.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.457954  4706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:57.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.459198  4706 hybrid_clock.cc:648] HybridClock initialized: now 1783468077459116 us; error 67 us; skew 500 ppm
23:47:57.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.459636  4706 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:57.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.462988  4706 webserver.cc:534] Webserver started at http://127.4.149.254:42399/ using document root <none> and password file <none>
23:47:57.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.463884  4706 fs_manager.cc:362] Metadata directory not provided
23:47:57.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.463995  4706 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:57.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.464300  4706 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:57.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.467008  4706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data/instance:
23:47:57.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c3feaf72154e4d1eaa529db494dd2c90"
23:47:57.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:57 on dist-test-slave-hfsf"
23:47:57.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.467804  4706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal/instance:
23:47:57.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c3feaf72154e4d1eaa529db494dd2c90"
23:47:57.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:57 on dist-test-slave-hfsf"
23:47:57.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.473719  4706 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
23:47:57.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.477533  4720 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.479231  4706 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.479395  4706 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c3feaf72154e4d1eaa529db494dd2c90"
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:57 on dist-test-slave-hfsf"
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.479574  4706 fs_report.cc:389] FS layout report
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:57.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data/data
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:57.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:57.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.504493  4706 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:57.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.505685  4706 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:57.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.506031  4706 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.528182  4706 rpc_server.cc:307] RPC server started. Bound to: 127.4.149.254:41393
23:47:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.528213  4772 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.149.254:41393 every 8 connection(s)
23:47:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.529909  4706 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/data/info.pb
23:47:57.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.534725  4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:57.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.537106  4695 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4706
23:47:57.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.537367  4695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-0/wal/instance
23:47:57.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.539764  4695 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/logs
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data/info.pb
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.253:38083
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.253
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46269/jwks.json with env {}
23:47:57.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.541656  4773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } has no permanent_uuid. Determining permanent_uuid...
23:47:57.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.561601  4773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } has no permanent_uuid. Determining permanent_uuid...
23:47:57.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.562980  4721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111)
23:47:57.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.565089  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.253:38083: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111)
23:47:57.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.612982  4685 heartbeater.cc:499] Master 127.3.230.252:37691 was elected leader, sending a full tablet report...
23:47:57.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.614535  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } attempt: 1
23:47:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.616633  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.253:38083: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111)
23:47:57.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468077668 for job bbc34d76ac15add629743db00c4f4a33.
23:47:57.682 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
23:47:57.682 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
23:47:57.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.684979  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } attempt: 2
23:47:57.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.687443  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.253:38083: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111)
23:47:57.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.778717  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } attempt: 3
23:47:57.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.781185  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.253:38083: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111)
23:47:57.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.909739  4775 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:57.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.910081  4775 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:57.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.910163  4775 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:57.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.919101  4775 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:57.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.919209  4775 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:57.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.919265  4775 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:57.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.919304  4775 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:57.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.919358  4775 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:57.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.919391  4775 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46269/jwks.json
23:47:57.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.924501  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } attempt: 4
23:47:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.926929  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.253:38083: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111)
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.931082  4775 master_runner.cc:387] Master server non-default flags:
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.253:38083
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46269/jwks.json
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data/info.pb
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.253
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/logs
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:57.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:57.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.933296  4775 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:57.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.935483  4775 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:57.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.944643  4783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:57.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.944598  4786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:57.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:57.944614  4784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:57.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.945677  4775 server_base.cc:1061] running on GCE node
23:47:57.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.946506  4775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:57.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.948125  4775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:57.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.949386  4775 hybrid_clock.cc:648] HybridClock initialized: now 1783468077949307 us; error 70 us; skew 500 ppm
23:47:57.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.949746  4775 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:57.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.952442  4775 webserver.cc:534] Webserver started at http://127.4.149.253:33873/ using document root <none> and password file <none>
23:47:57.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.953210  4775 fs_manager.cc:362] Metadata directory not provided
23:47:57.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.953306  4775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:57.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.953619  4775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.956269  4775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data/instance:
23:47:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25281fa178114dc8bc4d1576b68ea2c3"
23:47:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:57 on dist-test-slave-hfsf"
23:47:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.957031  4775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal/instance:
23:47:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25281fa178114dc8bc4d1576b68ea2c3"
23:47:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:57 on dist-test-slave-hfsf"
23:47:57.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.962968  4775 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
23:47:57.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.966643  4792 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.968292  4775 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.968464  4775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25281fa178114dc8bc4d1576b68ea2c3"
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:57 on dist-test-slave-hfsf"
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:57.968673  4775 fs_report.cc:389] FS layout report
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data/data
23:47:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:58.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.008807  4775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:58.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.009807  4775 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:58.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.010072  4775 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:58.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.035156  4775 rpc_server.cc:307] RPC server started. Bound to: 127.4.149.253:38083
23:47:58.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.035136  4843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.149.253:38083 every 8 connection(s)
23:47:58.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.036959  4775 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/data/info.pb
23:47:58.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.041741  4844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.043913  4695 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4775
23:47:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.044070  4695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-1/wal/instance
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.045187  4695 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/logs
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data/info.pb
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.252:44265
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.252
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46269/jwks.json with env {}
23:47:58.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.048980  4844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.063982  4844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.074699  4844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.076028  4794 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.077828  4844 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.127183  4844 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 1
23:47:58.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.129474  4844 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468078167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:58.179 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:47:58.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
23:47:58.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.197741  4844 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 2
23:47:58.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.200158  4844 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.226229  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } attempt: 5
23:47:58.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.233971  4773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.236106  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.287376  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 1
23:47:58.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.289551  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.291421  4844 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 3
23:47:58.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.293483  4844 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.357829  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 2
23:47:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.360523  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.436726  4844 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 4
23:47:58.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.439384  4844 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.441946  4846 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:58.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.442265  4846 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:58.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.442346  4846 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.451105  4846 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:47:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.451253  4846 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.451337  4846 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:47:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.451380  4846 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:47:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.451432  4846 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:47:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.451467  4846 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46269/jwks.json
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.463135  4846 master_runner.cc:387] Master server non-default flags:
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.252:44265
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46269/jwks.json
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data/info.pb
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.252
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/logs
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:58.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:58.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.464931  4846 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:58.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.466753  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 3
23:47:58.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.466960  4846 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:58.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.469013  4773 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.149.252:44265: Network error: Client connection negotiation failed: client connection to 127.4.149.252:44265: connect: Connection refused (error 111)
23:47:58.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.476838  4857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:58.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.476922  4859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:58.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.476899  4856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:58.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.478044  4846 server_base.cc:1061] running on GCE node
23:47:58.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.479004  4846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:58.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.480705  4846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:58.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.481956  4846 hybrid_clock.cc:648] HybridClock initialized: now 1783468078481902 us; error 44 us; skew 500 ppm
23:47:58.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.482416  4846 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:58.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.485241  4846 webserver.cc:534] Webserver started at http://127.4.149.252:42901/ using document root <none> and password file <none>
23:47:58.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.486255  4846 fs_manager.cc:362] Metadata directory not provided
23:47:58.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.486395  4846 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:58.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.486871  4846 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:58.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.490279  4846 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data/instance:
23:47:58.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e94e7039c04b4507b42c4905b94bdfb0"
23:47:58.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:58 on dist-test-slave-hfsf"
23:47:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.491313  4846 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal/instance:
23:47:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e94e7039c04b4507b42c4905b94bdfb0"
23:47:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:58 on dist-test-slave-hfsf"
23:47:58.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.498008  4846 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.002s
23:47:58.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.502136  4865 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.503888  4846 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.504137  4846 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e94e7039c04b4507b42c4905b94bdfb0"
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:58 on dist-test-slave-hfsf"
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.504493  4846 fs_report.cc:389] FS layout report
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data/data
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:58.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:58.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:58.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.534572  4846 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:58.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.535656  4846 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:58.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.536015  4846 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:58.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.558511  4846 rpc_server.cc:307] RPC server started. Bound to: 127.4.149.252:44265
23:47:58.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.558528  4916 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.149.252:44265 every 8 connection(s)
23:47:58.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.560307  4846 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/data/info.pb
23:47:58.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.564182  4695 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4846
23:47:58.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.564409  4695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/master-2/wal/instance
23:47:58.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.565591  4917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:47:58.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.573596  4917 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.590441  4917 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.601665  4917 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } has no permanent_uuid. Determining permanent_uuid...
23:47:58.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.613948  4917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: Bootstrap starting.
23:47:58.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.618369  4917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: Neither blocks nor log segments found. Creating new log.
23:47:58.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.619711  4917 log.cc:826] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: Log is configured to *not* fsync() on all Append() calls
23:47:58.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.622454  4917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: No bootstrap required, opened a new log
23:47:58.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.628160  4917 raft_consensus.cc:359] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.628521  4917 raft_consensus.cc:385] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:58.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.628640  4917 raft_consensus.cc:740] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94e7039c04b4507b42c4905b94bdfb0, State: Initialized, Role: FOLLOWER
23:47:58.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.629424  4917 consensus_queue.cc:260] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.630604  4926 sys_catalog.cc:455] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:58.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.630949  4926 sys_catalog.cc:458] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: This master's current role is: FOLLOWER
23:47:58.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.631827  4917 sys_catalog.cc:565] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: configured and running, proceeding with master startup.
23:47:58.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.639606  4846 master_runner.cc:187] Error getting master registration for 127.4.149.254:41393: OK, instance_id { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" instance_seqno: 1783468077522339 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:58.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.644307  4846 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:58.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.645852  4937 catalog_manager.cc:1593] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:58.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.645992  4937 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:58.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.646237  4773 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 4
23:47:58.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.657397  4773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: Bootstrap starting.
23:47:58.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.661510  4773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: Neither blocks nor log segments found. Creating new log.
23:47:58.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.662732  4773 log.cc:826] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: Log is configured to *not* fsync() on all Append() calls
23:47:58.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.665675  4773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: No bootstrap required, opened a new log
23:47:58.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468078667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:58.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.673398  4773 raft_consensus.cc:359] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.674098  4773 raft_consensus.cc:385] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:58.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.674389  4773 raft_consensus.cc:740] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3feaf72154e4d1eaa529db494dd2c90, State: Initialized, Role: FOLLOWER
23:47:58.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.675350  4773 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.687166  4940 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:58.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.687763  4940 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: This master's current role is: FOLLOWER
23:47:58.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.688961  4773 sys_catalog.cc:565] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: configured and running, proceeding with master startup.
23:47:58.689 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
23:47:58.691 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
23:47:58.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.707690  4951 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:58.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.708225  4951 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:58.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.706250  4706 master_runner.cc:187] Error getting master registration for 127.4.149.253:38083: OK, instance_id { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" instance_seqno: 1783468078028814 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:47:58.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.712240  4706 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:58.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.738637  4844 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } attempt: 5
23:47:58.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.751435  4844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: Bootstrap starting.
23:47:58.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.756078  4844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: Neither blocks nor log segments found. Creating new log.
23:47:58.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.757372  4844 log.cc:826] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: Log is configured to *not* fsync() on all Append() calls
23:47:58.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.759523  4727 tablet.cc:2406] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:58.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.761241  4844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: No bootstrap required, opened a new log
23:47:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.767618  4844 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.768067  4844 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:47:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.768210  4844 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25281fa178114dc8bc4d1576b68ea2c3, State: Initialized, Role: FOLLOWER
23:47:58.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.769078  4844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.773994  4954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.774729  4954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: This master's current role is: FOLLOWER
23:47:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.775741  4844 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: configured and running, proceeding with master startup.
23:47:58.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.788355  4871 tablet.cc:2406] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:58.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.814774  4775 master_runner.cc:264] No leader master found from master 25281fa178114dc8bc4d1576b68ea2c3
23:47:58.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.814949  4775 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:47:58.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.817828  4965 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:47:58.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:58.818209  4965 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:47:58.839 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:47:58.840 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:47:58.841 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:47:58.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:58.841 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:58.841 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:58.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:58.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:47:58.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:47:58.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:58.843 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:58.843 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:47:58.843 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:47:58.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.945447  4926 raft_consensus.cc:493] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:47:58.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.945755  4926 raft_consensus.cc:515] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.947646  4926 leader_election.cc:290] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3feaf72154e4d1eaa529db494dd2c90 (127.4.149.254:41393), 25281fa178114dc8bc4d1576b68ea2c3 (127.4.149.253:38083)
23:47:58.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.949577  4748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e94e7039c04b4507b42c4905b94bdfb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3feaf72154e4d1eaa529db494dd2c90" is_pre_election: true
23:47:58.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.950132  4748 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e94e7039c04b4507b42c4905b94bdfb0 in term 0.
23:47:58.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.950908  4819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e94e7039c04b4507b42c4905b94bdfb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25281fa178114dc8bc4d1576b68ea2c3" is_pre_election: true
23:47:58.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.951431  4819 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e94e7039c04b4507b42c4905b94bdfb0 in term 0.
23:47:58.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.952594  4866 leader_election.cc:304] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25281fa178114dc8bc4d1576b68ea2c3, e94e7039c04b4507b42c4905b94bdfb0; no voters: 
23:47:58.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.953915  4926 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:47:58.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.954077  4926 raft_consensus.cc:493] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:47:58.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.954169  4926 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 0 FOLLOWER]: Advancing to term 1
23:47:58.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.957695  4926 raft_consensus.cc:515] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.959398  4748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e94e7039c04b4507b42c4905b94bdfb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3feaf72154e4d1eaa529db494dd2c90"
23:47:58.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.959647  4748 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 0 FOLLOWER]: Advancing to term 1
23:47:58.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.964226  4748 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e94e7039c04b4507b42c4905b94bdfb0 in term 1.
23:47:58.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.964951  4869 leader_election.cc:304] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3feaf72154e4d1eaa529db494dd2c90, e94e7039c04b4507b42c4905b94bdfb0; no voters: 
23:47:58.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.966691  4819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e94e7039c04b4507b42c4905b94bdfb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25281fa178114dc8bc4d1576b68ea2c3"
23:47:58.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.967931  4819 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 0 FOLLOWER]: Advancing to term 1
23:47:58.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.972836  4819 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e94e7039c04b4507b42c4905b94bdfb0 in term 1.
23:47:58.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.976678  4926 leader_election.cc:290] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [CANDIDATE]: Term 1 election: Requested vote from peers c3feaf72154e4d1eaa529db494dd2c90 (127.4.149.254:41393), 25281fa178114dc8bc4d1576b68ea2c3 (127.4.149.253:38083)
23:47:58.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.977468  4926 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 1 FOLLOWER]: Leader election won for term 1
23:47:58.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.978144  4926 raft_consensus.cc:697] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [term 1 LEADER]: Becoming Leader. State: Replica: e94e7039c04b4507b42c4905b94bdfb0, State: Running, Role: LEADER
23:47:58.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.979444  4926 consensus_queue.cc:237] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } }
23:47:58.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.992304  4967 sys_catalog.cc:455] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e94e7039c04b4507b42c4905b94bdfb0. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:58.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:58.997525  4967 sys_catalog.cc:458] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: This master's current role is: LEADER
23:47:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.005246  4969 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:47:59.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.008018  4969 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:47:59.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.013335  4798 tablet.cc:2406] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:47:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.027344  4819 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [term 1 FOLLOWER]: Refusing update from remote peer e94e7039c04b4507b42c4905b94bdfb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:59.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.029958  4967 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:59.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.049772  4748 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [term 1 FOLLOWER]: Refusing update from remote peer e94e7039c04b4507b42c4905b94bdfb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:47:59.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.051189  4967 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:47:59.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.089020  4940 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e94e7039c04b4507b42c4905b94bdfb0. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:59.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.089277  4940 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: This master's current role is: FOLLOWER
23:47:59.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.101887  4970 mvcc.cc:204] Tried to move back new op lower bound from 7305085251670913024 to 7305085251514253312. Current Snapshot: MvccSnapshot[applied={T|T < 7305085251670913024}]
23:47:59.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.105481  4926 sys_catalog.cc:455] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:59.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.105765  4926 sys_catalog.cc:458] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: This master's current role is: LEADER
23:47:59.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.109171  4954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e94e7039c04b4507b42c4905b94bdfb0. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:59.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.109468  4954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: This master's current role is: FOLLOWER
23:47:59.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.110073  4972 mvcc.cc:204] Tried to move back new op lower bound from 7305085251670913024 to 7305085251514253312. Current Snapshot: MvccSnapshot[applied={T|T < 7305085251670913024}]
23:47:59.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.111385  4969 catalog_manager.cc:1382] Generated new cluster ID: adc78582c9ce4160b72aa0deee914245
23:47:59.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.111526  4969 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:47:59.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.114719  4967 sys_catalog.cc:455] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:59.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.115617  4967 sys_catalog.cc:458] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 [sys.catalog]: This master's current role is: LEADER
23:47:59.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.120676  4971 mvcc.cc:204] Tried to move back new op lower bound from 7305085251670913024 to 7305085251514253312. Current Snapshot: MvccSnapshot[applied={T|T < 7305085251670913024}]
23:47:59.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.122700  4940 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:59.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.129380  4940 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90 [sys.catalog]: This master's current role is: FOLLOWER
23:47:59.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.135565  4969 catalog_manager.cc:1405] Generated new certificate authority record
23:47:59.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.140858  4969 catalog_manager.cc:1539] Loading token signing keys...
23:47:59.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.142608  4954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e94e7039c04b4507b42c4905b94bdfb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3feaf72154e4d1eaa529db494dd2c90" member_type: VOTER last_known_addr { host: "127.4.149.254" port: 41393 } } peers { permanent_uuid: "25281fa178114dc8bc4d1576b68ea2c3" member_type: VOTER last_known_addr { host: "127.4.149.253" port: 38083 } } peers { permanent_uuid: "e94e7039c04b4507b42c4905b94bdfb0" member_type: VOTER last_known_addr { host: "127.4.149.252" port: 44265 } } }
23:47:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.142848  4954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3 [sys.catalog]: This master's current role is: FOLLOWER
23:47:59.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468079167 for job bbc34d76ac15add629743db00c4f4a33.
23:47:59.186 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
23:47:59.189 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
23:47:59.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.191071  4969 catalog_manager.cc:6069] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0: Generated new TSK 0
23:47:59.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.192672  4969 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.214015  4695 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/logs
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data/info.pb
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:59.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.193:0
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.149.193
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.193
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:59.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.647609  4981 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:47:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.648010  4981 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:47:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.648128  4981 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:47:59.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.657254  4981 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:47:59.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.657509  4981 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.149.193
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.668347  4981 tablet_server_runner.cc:78] Tablet server non-default flags:
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data
23:47:59.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468079667 for job bbc34d76ac15add629743db00c4f4a33.
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal
23:47:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.193:0
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data/info.pb
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.193
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.149.193
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/logs
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:47:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:47:59.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.670845  4981 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:47:59.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.673661  4981 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:47:59.684 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:47:59.688 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
23:47:59.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.688303  4986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:59.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.688943  4987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:59.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:47:59.690630  4990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:47:59.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.692418  4981 server_base.cc:1061] running on GCE node
23:47:59.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.693064  4981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:47:59.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.694142  4981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:47:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.695427  4981 hybrid_clock.cc:648] HybridClock initialized: now 1783468079695348 us; error 69 us; skew 500 ppm
23:47:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.695734  4981 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:47:59.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.697992  4981 webserver.cc:534] Webserver started at http://127.4.149.193:33619/ using document root <none> and password file <none>
23:47:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.698868  4981 fs_manager.cc:362] Metadata directory not provided
23:47:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.698969  4981 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:47:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.699472  4981 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:47:59.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.701954  4981 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data/instance:
23:47:59.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce4de942beb74ff39c48ff0e7609df79"
23:47:59.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:59 on dist-test-slave-hfsf"
23:47:59.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.702878  4981 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal/instance:
23:47:59.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce4de942beb74ff39c48ff0e7609df79"
23:47:59.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:59 on dist-test-slave-hfsf"
23:47:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.709026  4981 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.002s
23:47:59.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.710721  4951 catalog_manager.cc:1294] Loaded cluster ID: adc78582c9ce4160b72aa0deee914245
23:47:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.710867  4951 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: loading cluster ID for follower catalog manager: success
23:47:59.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.713349  4996 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:47:59.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.714643  4951 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: acquiring CA information for follower catalog manager: success
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.715063  4981 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.715226  4981 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce4de942beb74ff39c48ff0e7609df79"
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:47:59 on dist-test-slave-hfsf"
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.715454  4981 fs_report.cc:389] FS layout report
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data/data
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:47:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:47:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:47:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:47:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:47:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:47:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:47:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:47:59.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.717229  4951 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c3feaf72154e4d1eaa529db494dd2c90: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:59.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.736660  4981 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:47:59.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.737668  4981 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:47:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.737954  4981 kserver.cc:163] Server-wide thread pool size limit: 3276
23:47:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.739149  4981 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:47:59.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.740934  4981 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:47:59.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.741029  4981 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:47:59.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.741106  4981 ts_tablet_manager.cc:616] Registered 0 tablets
23:47:59.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.741156  4981 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:47:59.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.777345  4981 rpc_server.cc:307] RPC server started. Bound to: 127.4.149.193:36799
23:47:59.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.777395  5108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.149.193:36799 every 8 connection(s)
23:47:59.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.779297  4981 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/data/info.pb
23:47:59.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.789009  4695 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 4981
23:47:59.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.789280  4695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-0/wal/instance
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.813450  5111 heartbeater.cc:344] Connected to a master server at 127.4.149.253:38083
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.813932  5111 heartbeater.cc:461] Registering TS with master...
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.814946  4695 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/logs
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data/info.pb
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:47:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.194:0
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.149.194
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.194
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:47:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.815253  5111 heartbeater.cc:507] Master 127.4.149.253:38083 requested a full tablet report, sending...
23:47:59.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.818128  4809 ts_manager.cc:194] Registered new tserver with Master: ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193:36799)
23:47:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.820669  4965 catalog_manager.cc:1294] Loaded cluster ID: adc78582c9ce4160b72aa0deee914245
23:47:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.820770  4965 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: loading cluster ID for follower catalog manager: success
23:47:59.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.824743  4965 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: acquiring CA information for follower catalog manager: success
23:47:59.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.827468  4965 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 25281fa178114dc8bc4d1576b68ea2c3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:47:59.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.824406  5110 heartbeater.cc:344] Connected to a master server at 127.4.149.254:41393
23:47:59.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.828186  5110 heartbeater.cc:461] Registering TS with master...
23:47:59.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.830091  5110 heartbeater.cc:507] Master 127.4.149.254:41393 requested a full tablet report, sending...
23:47:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.832101  4738 ts_manager.cc:194] Registered new tserver with Master: ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193:36799)
23:47:59.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.834028  5109 heartbeater.cc:344] Connected to a master server at 127.4.149.252:44265
23:47:59.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.834205  5109 heartbeater.cc:461] Registering TS with master...
23:47:59.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.834846  5109 heartbeater.cc:507] Master 127.4.149.252:44265 requested a full tablet report, sending...
23:47:59.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.836468  4882 ts_manager.cc:194] Registered new tserver with Master: ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193:36799)
23:47:59.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:47:59.838125  4882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.149.193:35381
23:48:00.169 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468080168 for job bbc34d76ac15add629743db00c4f4a33.
23:48:00.182 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:48:00.183 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
23:48:00.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.197626  5119 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:00.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.197958  5119 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:00.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.198144  5119 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:00.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.207119  5119 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:00.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.207302  5119 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.149.194
23:48:00.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.219625  5119 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.194:0
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data/info.pb
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.194
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.149.194
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/logs
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:00.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:00.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.221560  5119 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:00.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.223641  5119 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:00.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.234216  5124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:00.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.234220  5125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:00.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.234220  5127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:00.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.235721  5119 server_base.cc:1061] running on GCE node
23:48:00.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.236472  5119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:00.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.237659  5119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.239034  5119 hybrid_clock.cc:648] HybridClock initialized: now 1783468080238951 us; error 69 us; skew 500 ppm
23:48:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.239423  5119 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:00.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.242530  5119 webserver.cc:534] Webserver started at http://127.4.149.194:41165/ using document root <none> and password file <none>
23:48:00.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.243718  5119 fs_manager.cc:362] Metadata directory not provided
23:48:00.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.243876  5119 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.244372  5119 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:00.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.248327  5119 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data/instance:
23:48:00.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:00.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:00 on dist-test-slave-hfsf"
23:48:00.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.249500  5119 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal/instance:
23:48:00.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:00.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:00 on dist-test-slave-hfsf"
23:48:00.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.256223  5119 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
23:48:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.260325  5133 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.262974  5119 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
23:48:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.263446  5119 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal
23:48:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:00 on dist-test-slave-hfsf"
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.263715  5119 fs_report.cc:389] FS layout report
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data/data
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.282548  5119 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.283612  5119 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:00.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.283950  5119 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:00.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.285061  5119 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:00.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.287133  5119 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:00.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.287273  5119 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:00.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.287387  5119 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:00.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.287464  5119 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.339180  5119 rpc_server.cc:307] RPC server started. Bound to: 127.4.149.194:34185
23:48:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.339231  5247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.149.194:34185 every 8 connection(s)
23:48:00.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.340719  5119 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/data/info.pb
23:48:00.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.341019  4695 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 5119
23:48:00.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.341172  4695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-1/wal/instance
23:48:00.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.346684  4695 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/logs
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data/info.pb
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.195:0
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.149.195
23:48:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.195
23:48:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:48:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:48:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:00.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.370972  5249 heartbeater.cc:344] Connected to a master server at 127.4.149.254:41393
23:48:00.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.371480  5249 heartbeater.cc:461] Registering TS with master...
23:48:00.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.372694  5249 heartbeater.cc:507] Master 127.4.149.254:41393 requested a full tablet report, sending...
23:48:00.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.374032  5250 heartbeater.cc:344] Connected to a master server at 127.4.149.253:38083
23:48:00.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.374421  5250 heartbeater.cc:461] Registering TS with master...
23:48:00.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.375057  4738 ts_manager.cc:194] Registered new tserver with Master: 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185)
23:48:00.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.375183  5250 heartbeater.cc:507] Master 127.4.149.253:38083 requested a full tablet report, sending...
23:48:00.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.376080  5248 heartbeater.cc:344] Connected to a master server at 127.4.149.252:44265
23:48:00.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.376389  5248 heartbeater.cc:461] Registering TS with master...
23:48:00.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.376979  5248 heartbeater.cc:507] Master 127.4.149.252:44265 requested a full tablet report, sending...
23:48:00.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.377476  4809 ts_manager.cc:194] Registered new tserver with Master: 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185)
23:48:00.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.378082  4882 ts_manager.cc:194] Registered new tserver with Master: 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185)
23:48:00.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.379036  4882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.149.194:36089
23:48:00.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468080667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:00.679 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:00.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
23:48:00.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.759277  5257 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:00.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.759766  5257 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:00.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.759892  5257 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:00.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.773388  5257 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:00.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.773650  5257 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.149.195
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.790086  5257 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.149.212:34667
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.149.195:0
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data/info.pb
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.149.195
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.149.254:41393,127.4.149.253:38083,127.4.149.252:44265
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:00.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.149.195
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/logs
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.792510  5257 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:00.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.795177  5257 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:00.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.809320  5263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:00.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.810377  5264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:00.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:00.810477  5266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.812501  5257 server_base.cc:1061] running on GCE node
23:48:00.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.813249  5257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:00.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.814591  5257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:00.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.816005  5257 hybrid_clock.cc:648] HybridClock initialized: now 1783468080815870 us; error 130 us; skew 500 ppm
23:48:00.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.816433  5257 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:00.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.822970  5257 webserver.cc:534] Webserver started at http://127.4.149.195:42315/ using document root <none> and password file <none>
23:48:00.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.824138  5257 fs_manager.cc:362] Metadata directory not provided
23:48:00.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.824503  5257 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:00.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.824983  5257 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:00.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.827896  5257 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data/instance:
23:48:00.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:00.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:00 on dist-test-slave-hfsf"
23:48:00.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.828926  5257 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal/instance:
23:48:00.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:00.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:00 on dist-test-slave-hfsf"
23:48:00.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.835755  5257 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:48:00.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.839908  5272 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:00.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.841034  5109 heartbeater.cc:499] Master 127.4.149.252:44265 was elected leader, sending a full tablet report...
23:48:00.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.842247  5257 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
23:48:00.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.842478  5257 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal
23:48:00.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:00.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:00 on dist-test-slave-hfsf"
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.842757  5257 fs_report.cc:389] FS layout report
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data/data
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:00.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.863302  5257 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:00.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.864401  5257 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:00.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.864791  5257 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:00.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.865955  5257 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:00.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.868093  5257 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:00.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.868229  5257 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:00.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.868343  5257 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:00.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.868431  5257 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:00.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.924768  5257 rpc_server.cc:307] RPC server started. Bound to: 127.4.149.195:44019
23:48:00.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.924794  5385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.149.195:44019 every 8 connection(s)
23:48:00.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.926574  5257 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/data/info.pb
23:48:00.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.928804  4695 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 5257
23:48:00.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.928960  4695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster4804836053100228483/ts-2/wal/instance
23:48:00.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.979298  5387 heartbeater.cc:344] Connected to a master server at 127.4.149.254:41393
23:48:00.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.979808  5387 heartbeater.cc:461] Registering TS with master...
23:48:00.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.981112  5386 heartbeater.cc:344] Connected to a master server at 127.4.149.252:44265
23:48:00.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.981259  5386 heartbeater.cc:461] Registering TS with master...
23:48:00.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.981479  5387 heartbeater.cc:507] Master 127.4.149.254:41393 requested a full tablet report, sending...
23:48:00.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.982271  5386 heartbeater.cc:507] Master 127.4.149.252:44265 requested a full tablet report, sending...
23:48:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.983321  5388 heartbeater.cc:344] Connected to a master server at 127.4.149.253:38083
23:48:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.983461  5388 heartbeater.cc:461] Registering TS with master...
23:48:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.983465  4882 ts_manager.cc:194] Registered new tserver with Master: 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.983640  4738 ts_manager.cc:194] Registered new tserver with Master: 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.983959  5388 heartbeater.cc:507] Master 127.4.149.253:38083 requested a full tablet report, sending...
23:48:00.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.984619  4882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.149.195:38569
23:48:00.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.985507  4809 ts_manager.cc:194] Registered new tserver with Master: 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:00.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:00.994316  4695 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:00.997 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:00.997 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:00.999 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.149.254"
      port: 41393
    }
    bound_http_address {
      host: "127.4.149.254"
      port: 42399
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.149.253"
      port: 38083
    }
    bound_http_address {
      host: "127.4.149.253"
      port: 33873
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.149.252"
      port: 44265
    }
    bound_http_address {
      host: "127.4.149.252"
      port: 42901
    }
  }
}

23:48:00.999 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:01.001 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.149.193"
      port: 36799
    }
    bound_http_address {
      host: "127.4.149.193"
      port: 33619
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.149.194"
      port: 34185
    }
    bound_http_address {
      host: "127.4.149.194"
      port: 41165
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.149.195"
      port: 44019
    }
    bound_http_address {
      host: "127.4.149.195"
      port: 42315
    }
  }
}

23:48:01.001 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:01.004 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:01.012 [DEBUG - main] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:01.014 [DEBUG - main] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:01.014 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:01.018 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:01.019 [DEBUG - main] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:01.020 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:01.030 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.254
23:48:01.030 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:01.036 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:01.037 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:01.053 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6c5dc5b6, L:/127.0.0.1:54620 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:01.053 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:01.056 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x03e625f9, L:/127.0.0.1:48862 - R:/127.3.230.254:44025] using SASL/PLAIN
23:48:01.062 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:01.066 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf0bb73bf, L:/127.0.0.1:49370 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:01.069 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:01.070 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=57), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:01.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.072441  4183 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49370:
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:01.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:01.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:01.076185  4183 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:01.102 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.147714  4339 tablet_service.cc:1511] Processing CreateTablet for tablet 2abbce68bf9b4cc0b8028cafc59c9d59 (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.146318  4478 tablet_service.cc:1511] Processing CreateTablet for tablet 2abbce68bf9b4cc0b8028cafc59c9d59 (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.147068  4342 tablet_service.cc:1511] Processing CreateTablet for tablet ad1717b59e6a4882bde027a3330b8294 (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.146780  4338 tablet_service.cc:1511] Processing CreateTablet for tablet d157534ed83945df9c51a974fa62d3dd (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.147233  4341 tablet_service.cc:1511] Processing CreateTablet for tablet adcf4679f475414d88d97e4f0da4cdfd (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.147581  4340 tablet_service.cc:1511] Processing CreateTablet for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.148823  4478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abbce68bf9b4cc0b8028cafc59c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.148823  4339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abbce68bf9b4cc0b8028cafc59c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.149256  4340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.149744  4342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1717b59e6a4882bde027a3330b8294. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.150835  4341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcf4679f475414d88d97e4f0da4cdfd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.152309  4338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157534ed83945df9c51a974fa62d3dd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.156934  4617 tablet_service.cc:1511] Processing CreateTablet for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.159529  4615 tablet_service.cc:1511] Processing CreateTablet for tablet d157534ed83945df9c51a974fa62d3dd (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.160342  4616 tablet_service.cc:1511] Processing CreateTablet for tablet 2abbce68bf9b4cc0b8028cafc59c9d59 (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.161110  4618 tablet_service.cc:1511] Processing CreateTablet for tablet adcf4679f475414d88d97e4f0da4cdfd (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.146469  4481 tablet_service.cc:1511] Processing CreateTablet for tablet ad1717b59e6a4882bde027a3330b8294 (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.162250  4481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1717b59e6a4882bde027a3330b8294. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.146346  4480 tablet_service.cc:1511] Processing CreateTablet for tablet adcf4679f475414d88d97e4f0da4cdfd (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.163393  4480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcf4679f475414d88d97e4f0da4cdfd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.169 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468081168 for job bbc34d76ac15add629743db00c4f4a33.
23:48:01.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.166957  4617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.170964  4616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abbce68bf9b4cc0b8028cafc59c9d59. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.174391  4615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157534ed83945df9c51a974fa62d3dd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.176700  5419 tablet_bootstrap.cc:492] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: Bootstrap starting.
23:48:01.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.178139  4618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcf4679f475414d88d97e4f0da4cdfd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.182633  5419 tablet_bootstrap.cc:654] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: Neither blocks nor log segments found. Creating new log.
23:48:01.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.184401  5419 log.cc:826] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: Log is configured to *not* fsync() on all Append() calls
23:48:01.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.186618  4619 tablet_service.cc:1511] Processing CreateTablet for tablet ad1717b59e6a4882bde027a3330b8294 (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.145081  4477 tablet_service.cc:1511] Processing CreateTablet for tablet d157534ed83945df9c51a974fa62d3dd (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.187932  4619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1717b59e6a4882bde027a3330b8294. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.188089  4477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157534ed83945df9c51a974fa62d3dd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.147456  4479 tablet_service.cc:1511] Processing CreateTablet for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc (DEFAULT_TABLE table=replication_test_table [id=fec8e6d6ddec481ba78f51dba8b87df3]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:01.226 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
23:48:01.227 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:01.228 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:01.228 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:01.231 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:01.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:01.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:01.233 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:01.233 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:01.233 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:01.233 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:01.234 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:01.234 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:01.234 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:01.237 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
23:48:01.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.199005  4479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.232522  5421 tablet_bootstrap.cc:492] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2: Bootstrap starting.
23:48:01.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.242655  5421 tablet_bootstrap.cc:654] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2: Neither blocks nor log segments found. Creating new log.
23:48:01.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.244274  5421 log.cc:826] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2: Log is configured to *not* fsync() on all Append() calls
23:48:01.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.260900  5422 tablet_bootstrap.cc:492] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: Bootstrap starting.
23:48:01.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.265095  5421 tablet_bootstrap.cc:492] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2: No bootstrap required, opened a new log
23:48:01.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.265446  5421 ts_tablet_manager.cc:1403] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.011s
23:48:01.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.268915  5422 tablet_bootstrap.cc:654] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: Neither blocks nor log segments found. Creating new log.
23:48:01.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.269016  5419 tablet_bootstrap.cc:492] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: No bootstrap required, opened a new log
23:48:01.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.269345  5419 ts_tablet_manager.cc:1403] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.032s
23:48:01.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.270887  5422 log.cc:826] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: Log is configured to *not* fsync() on all Append() calls
23:48:01.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.273506  5421 raft_consensus.cc:359] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.274212  5421 raft_consensus.cc:385] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.274456  5421 raft_consensus.cc:740] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9460cad6b24b4916b63842f2742139a2, State: Initialized, Role: FOLLOWER
23:48:01.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.275370  5421 consensus_queue.cc:260] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.279107  5419 raft_consensus.cc:359] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.279561  5419 raft_consensus.cc:385] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.279670  5419 raft_consensus.cc:740] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Initialized, Role: FOLLOWER
23:48:01.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.280957  5422 tablet_bootstrap.cc:492] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: No bootstrap required, opened a new log
23:48:01.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.281457  5422 ts_tablet_manager.cc:1403] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
23:48:01.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.282656  5419 consensus_queue.cc:260] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.291543  5419 ts_tablet_manager.cc:1434] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.008s
23:48:01.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.293586  5422 raft_consensus.cc:359] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.294399  5422 raft_consensus.cc:385] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.294685  5422 raft_consensus.cc:740] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Initialized, Role: FOLLOWER
23:48:01.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.295850  5419 tablet_bootstrap.cc:492] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19: Bootstrap starting.
23:48:01.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.295698  5422 consensus_queue.cc:260] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.298375  5419 tablet_bootstrap.cc:654] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19: Neither blocks nor log segments found. Creating new log.
23:48:01.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.308838  5419 tablet_bootstrap.cc:492] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19: No bootstrap required, opened a new log
23:48:01.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.309024  5419 ts_tablet_manager.cc:1403] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.002s
23:48:01.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.310213  5419 raft_consensus.cc:359] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.311017  5419 raft_consensus.cc:385] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.311133  5419 raft_consensus.cc:740] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Initialized, Role: FOLLOWER
23:48:01.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.311640  5419 consensus_queue.cc:260] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.314039  5419 ts_tablet_manager.cc:1434] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.002s
23:48:01.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.316411  5419 tablet_bootstrap.cc:492] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19: Bootstrap starting.
23:48:01.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.316742  5422 ts_tablet_manager.cc:1434] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: Time spent starting tablet: real 0.035s	user 0.014s	sys 0.005s
23:48:01.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.318502  5419 tablet_bootstrap.cc:654] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19: Neither blocks nor log segments found. Creating new log.
23:48:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.322342  5419 tablet_bootstrap.cc:492] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19: No bootstrap required, opened a new log
23:48:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.322568  5419 ts_tablet_manager.cc:1403] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
23:48:01.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.323490  5419 raft_consensus.cc:359] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.323714  5419 raft_consensus.cc:385] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.323802  5419 raft_consensus.cc:740] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Initialized, Role: FOLLOWER
23:48:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.324129  5419 consensus_queue.cc:260] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.327298  5419 ts_tablet_manager.cc:1434] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
23:48:01.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.329839  5419 tablet_bootstrap.cc:492] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19: Bootstrap starting.
23:48:01.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.332729  5419 tablet_bootstrap.cc:654] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19: Neither blocks nor log segments found. Creating new log.
23:48:01.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:01.335426  4688 tablet.cc:2406] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:01.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.336567  5421 ts_tablet_manager.cc:1434] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2: Time spent starting tablet: real 0.071s	user 0.016s	sys 0.008s
23:48:01.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.337113  5421 tablet_bootstrap.cc:492] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2: Bootstrap starting.
23:48:01.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.343266  5421 tablet_bootstrap.cc:654] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2: Neither blocks nor log segments found. Creating new log.
23:48:01.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.344544  5422 tablet_bootstrap.cc:492] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189: Bootstrap starting.
23:48:01.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.347476  5422 tablet_bootstrap.cc:654] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189: Neither blocks nor log segments found. Creating new log.
23:48:01.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.351851  5421 tablet_bootstrap.cc:492] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2: No bootstrap required, opened a new log
23:48:01.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.352041  5421 ts_tablet_manager.cc:1403] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
23:48:01.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.353365  5421 raft_consensus.cc:359] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.353632  5421 raft_consensus.cc:385] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.353745  5421 raft_consensus.cc:740] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9460cad6b24b4916b63842f2742139a2, State: Initialized, Role: FOLLOWER
23:48:01.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.354051  5421 consensus_queue.cc:260] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.354830  5421 ts_tablet_manager.cc:1434] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.001s
23:48:01.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.356122  5422 tablet_bootstrap.cc:492] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189: No bootstrap required, opened a new log
23:48:01.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.356324  5422 ts_tablet_manager.cc:1403] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.000s
23:48:01.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.357158  5422 raft_consensus.cc:359] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.357348  5422 raft_consensus.cc:385] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.357437  5422 raft_consensus.cc:740] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Initialized, Role: FOLLOWER
23:48:01.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.357843  5421 tablet_bootstrap.cc:492] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2: Bootstrap starting.
23:48:01.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.357769  5422 consensus_queue.cc:260] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.358946  5422 ts_tablet_manager.cc:1434] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:01.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.359375  5422 tablet_bootstrap.cc:492] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189: Bootstrap starting.
23:48:01.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.363626  5421 tablet_bootstrap.cc:654] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2: Neither blocks nor log segments found. Creating new log.
23:48:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.372587  5422 tablet_bootstrap.cc:654] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189: Neither blocks nor log segments found. Creating new log.
23:48:01.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.373939  5421 tablet_bootstrap.cc:492] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2: No bootstrap required, opened a new log
23:48:01.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.374130  5421 ts_tablet_manager.cc:1403] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.007s
23:48:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.375052  5421 raft_consensus.cc:359] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.375264  5421 raft_consensus.cc:385] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.375344  5421 raft_consensus.cc:740] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9460cad6b24b4916b63842f2742139a2, State: Initialized, Role: FOLLOWER
23:48:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.375607  5421 consensus_queue.cc:260] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.376322  5421 ts_tablet_manager.cc:1434] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:01.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.376643  5421 tablet_bootstrap.cc:492] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2: Bootstrap starting.
23:48:01.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.381009  5421 tablet_bootstrap.cc:654] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2: Neither blocks nor log segments found. Creating new log.
23:48:01.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.382068  5248 heartbeater.cc:499] Master 127.4.149.252:44265 was elected leader, sending a full tablet report...
23:48:01.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.386662  5422 tablet_bootstrap.cc:492] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189: No bootstrap required, opened a new log
23:48:01.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.387257  5422 ts_tablet_manager.cc:1403] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.000s
23:48:01.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.388576  5422 raft_consensus.cc:359] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.389058  5422 raft_consensus.cc:385] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.389292  5422 raft_consensus.cc:740] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Initialized, Role: FOLLOWER
23:48:01.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.389860  5422 consensus_queue.cc:260] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.392463  5422 ts_tablet_manager.cc:1434] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
23:48:01.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.392987  5422 tablet_bootstrap.cc:492] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189: Bootstrap starting.
23:48:01.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.396337  5422 tablet_bootstrap.cc:654] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189: Neither blocks nor log segments found. Creating new log.
23:48:01.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.405520  5422 tablet_bootstrap.cc:492] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189: No bootstrap required, opened a new log
23:48:01.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.406036  5422 ts_tablet_manager.cc:1403] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
23:48:01.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.407357  5422 raft_consensus.cc:359] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.408383  5422 raft_consensus.cc:385] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.408715  5422 raft_consensus.cc:740] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Initialized, Role: FOLLOWER
23:48:01.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.409220  5422 consensus_queue.cc:260] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.410241  5422 ts_tablet_manager.cc:1434] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
23:48:01.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.410727  5422 tablet_bootstrap.cc:492] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189: Bootstrap starting.
23:48:01.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.412910  5422 tablet_bootstrap.cc:654] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189: Neither blocks nor log segments found. Creating new log.
23:48:01.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.418916  5421 tablet_bootstrap.cc:492] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2: No bootstrap required, opened a new log
23:48:01.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.418964  5419 tablet_bootstrap.cc:492] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19: No bootstrap required, opened a new log
23:48:01.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.419111  5421 ts_tablet_manager.cc:1403] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.013s
23:48:01.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.419126  5419 ts_tablet_manager.cc:1403] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19: Time spent bootstrapping tablet: real 0.089s	user 0.029s	sys 0.051s
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420018  5419 raft_consensus.cc:359] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420238  5419 raft_consensus.cc:385] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420339  5419 raft_consensus.cc:740] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Initialized, Role: FOLLOWER
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420224  5421 raft_consensus.cc:359] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420433  5421 raft_consensus.cc:385] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420531  5421 raft_consensus.cc:740] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9460cad6b24b4916b63842f2742139a2, State: Initialized, Role: FOLLOWER
23:48:01.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420574  5419 consensus_queue.cc:260] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.420821  5421 consensus_queue.cc:260] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.421861  5419 ts_tablet_manager.cc:1434] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.002s
23:48:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.422178  5419 tablet_bootstrap.cc:492] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19: Bootstrap starting.
23:48:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.424285  5419 tablet_bootstrap.cc:654] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19: Neither blocks nor log segments found. Creating new log.
23:48:01.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.424896  5421 ts_tablet_manager.cc:1434] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
23:48:01.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.427556  5426 raft_consensus.cc:493] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:01.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.427891  5426 raft_consensus.cc:515] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.428808  5421 tablet_bootstrap.cc:492] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2: Bootstrap starting.
23:48:01.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.430756  5421 tablet_bootstrap.cc:654] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2: Neither blocks nor log segments found. Creating new log.
23:48:01.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.434206  5426 leader_election.cc:290] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625), 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:48:01.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.446844  5419 tablet_bootstrap.cc:492] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19: No bootstrap required, opened a new log
23:48:01.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.447136  5419 ts_tablet_manager.cc:1403] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.000s
23:48:01.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.448184  5419 raft_consensus.cc:359] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.448443  5419 raft_consensus.cc:385] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.448525  5419 raft_consensus.cc:740] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Initialized, Role: FOLLOWER
23:48:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.448941  5419 consensus_queue.cc:260] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.449651  5419 ts_tablet_manager.cc:1434] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:01.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.452961  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1717b59e6a4882bde027a3330b8294" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2" is_pre_election: true
23:48:01.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.453742  4501 raft_consensus.cc:2468] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 0.
23:48:01.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.454614  4296 leader_election.cc:304] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9460cad6b24b4916b63842f2742139a2, 9c56332fbfac479b9424d32d20cd3a19; no voters: 
23:48:01.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.455127  5426 raft_consensus.cc:2804] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:01.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.455310  5426 raft_consensus.cc:493] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:01.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.455443  5426 raft_consensus.cc:3060] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.456666  5442 raft_consensus.cc:493] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:01.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.457052  5442 raft_consensus.cc:515] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.457301  5421 tablet_bootstrap.cc:492] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2: No bootstrap required, opened a new log
23:48:01.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.457477  5421 ts_tablet_manager.cc:1403] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.009s
23:48:01.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.458391  5421 raft_consensus.cc:359] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.458846  5421 raft_consensus.cc:385] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.458952  5421 raft_consensus.cc:740] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9460cad6b24b4916b63842f2742139a2, State: Initialized, Role: FOLLOWER
23:48:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.458833  5442 leader_election.cc:290] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625), 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:48:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.458988  4640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1717b59e6a4882bde027a3330b8294" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19df80ee04424f9dfce1f351ce4189" is_pre_election: true
23:48:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.459215  5421 consensus_queue.cc:260] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.459509  4640 raft_consensus.cc:2468] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 0.
23:48:01.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.459502  5426 raft_consensus.cc:515] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.460618  5426 leader_election.cc:290] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 election: Requested vote from peers 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625), 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:48:01.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.460935  5421 ts_tablet_manager.cc:1434] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
23:48:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.461102  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1717b59e6a4882bde027a3330b8294" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2"
23:48:01.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.461385  4500 raft_consensus.cc:3060] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.461774  4639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1717b59e6a4882bde027a3330b8294" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19df80ee04424f9dfce1f351ce4189"
23:48:01.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.461992  4639 raft_consensus.cc:3060] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.464373  4639 raft_consensus.cc:2468] T ad1717b59e6a4882bde027a3330b8294 P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 1.
23:48:01.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.464958  4500 raft_consensus.cc:2468] T ad1717b59e6a4882bde027a3330b8294 P 9460cad6b24b4916b63842f2742139a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 1.
23:48:01.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.465757  4296 leader_election.cc:304] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9460cad6b24b4916b63842f2742139a2, 9c56332fbfac479b9424d32d20cd3a19; no voters: 
23:48:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.466121  5426 raft_consensus.cc:2804] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Leader election won for term 1
23:48:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.466346  5426 raft_consensus.cc:697] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [term 1 LEADER]: Becoming Leader. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Running, Role: LEADER
23:48:01.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.467069  5426 consensus_queue.cc:237] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.467490  4640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abbce68bf9b4cc0b8028cafc59c9d59" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19df80ee04424f9dfce1f351ce4189" is_pre_election: true
23:48:01.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.467727  4640 raft_consensus.cc:2468] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 0.
23:48:01.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.468254  4294 leader_election.cc:304] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19df80ee04424f9dfce1f351ce4189, 9c56332fbfac479b9424d32d20cd3a19; no voters: 
23:48:01.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.469195  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abbce68bf9b4cc0b8028cafc59c9d59" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2" is_pre_election: true
23:48:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.469455  4501 raft_consensus.cc:2468] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 0.
23:48:01.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.475718  5442 raft_consensus.cc:2804] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:01.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.475917  5442 raft_consensus.cc:493] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:01.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.476466  5442 raft_consensus.cc:3060] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.479861  5422 tablet_bootstrap.cc:492] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189: No bootstrap required, opened a new log
23:48:01.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.480132  5422 ts_tablet_manager.cc:1403] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189: Time spent bootstrapping tablet: real 0.070s	user 0.003s	sys 0.009s
23:48:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.481302  5422 raft_consensus.cc:359] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.481583  5422 raft_consensus.cc:385] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:01.481598  4410 tablet.cc:2406] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.481668  5422 raft_consensus.cc:740] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Initialized, Role: FOLLOWER
23:48:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.482028  5422 consensus_queue.cc:260] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.483855  5422 ts_tablet_manager.cc:1434] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.001s
23:48:01.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.488667  4183 catalog_manager.cc:5696] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193). New cstate: current_term: 1 leader_uuid: "9c56332fbfac479b9424d32d20cd3a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } health_report { overall_health: UNKNOWN } } }
23:48:01.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.495472  5442 raft_consensus.cc:515] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.496930  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abbce68bf9b4cc0b8028cafc59c9d59" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2"
23:48:01.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.497181  4501 raft_consensus.cc:3060] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.499306  5442 leader_election.cc:290] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 election: Requested vote from peers 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625), 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:48:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.500348  4640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abbce68bf9b4cc0b8028cafc59c9d59" candidate_uuid: "9c56332fbfac479b9424d32d20cd3a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19df80ee04424f9dfce1f351ce4189"
23:48:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.500658  4640 raft_consensus.cc:3060] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.505920  5427 raft_consensus.cc:493] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.506203  5427 raft_consensus.cc:515] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.509588  4501 raft_consensus.cc:2468] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 1.
23:48:01.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.512454  4640 raft_consensus.cc:2468] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c56332fbfac479b9424d32d20cd3a19 in term 1.
23:48:01.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.513028  4296 leader_election.cc:304] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9460cad6b24b4916b63842f2742139a2, 9c56332fbfac479b9424d32d20cd3a19; no voters: 
23:48:01.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.513402  5442 raft_consensus.cc:2804] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Leader election won for term 1
23:48:01.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.513571  5442 raft_consensus.cc:697] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [term 1 LEADER]: Becoming Leader. State: Replica: 9c56332fbfac479b9424d32d20cd3a19, State: Running, Role: LEADER
23:48:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.513906  5442 consensus_queue.cc:237] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.516661  5427 leader_election.cc:290] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511), 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:48:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.519347  5425 raft_consensus.cc:493] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.519568  5425 raft_consensus.cc:515] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.522015  4183 catalog_manager.cc:5696] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193). New cstate: current_term: 1 leader_uuid: "9c56332fbfac479b9424d32d20cd3a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } health_report { overall_health: UNKNOWN } } }
23:48:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.522558  5425 leader_election.cc:290] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511), 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:48:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.531962  5427 raft_consensus.cc:493] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:01.532168  4549 tablet.cc:2406] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9460cad6b24b4916b63842f2742139a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.532223  5427 raft_consensus.cc:515] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.533078  5427 leader_election.cc:290] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511), 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:48:01.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.534528  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcf4679f475414d88d97e4f0da4cdfd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2" is_pre_election: true
23:48:01.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.534837  4501 raft_consensus.cc:2468] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 0.
23:48:01.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.535267  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcf4679f475414d88d97e4f0da4cdfd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c56332fbfac479b9424d32d20cd3a19" is_pre_election: true
23:48:01.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.535701  4362 raft_consensus.cc:2468] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 0.
23:48:01.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.536459  4573 leader_election.cc:304] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19df80ee04424f9dfce1f351ce4189, 9460cad6b24b4916b63842f2742139a2; no voters: 
23:48:01.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.538221  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157534ed83945df9c51a974fa62d3dd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2" is_pre_election: true
23:48:01.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.538483  4501 raft_consensus.cc:2468] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 0.
23:48:01.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.539322  4573 leader_election.cc:304] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19df80ee04424f9dfce1f351ce4189, 9460cad6b24b4916b63842f2742139a2; no voters: 
23:48:01.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.540091  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157534ed83945df9c51a974fa62d3dd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c56332fbfac479b9424d32d20cd3a19" is_pre_election: true
23:48:01.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.540349  4362 raft_consensus.cc:2468] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 0.
23:48:01.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.541216  5427 raft_consensus.cc:2804] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:01.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.541354  5427 raft_consensus.cc:493] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:01.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.541466  5427 raft_consensus.cc:3060] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.544875  5427 raft_consensus.cc:515] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.546376  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcf4679f475414d88d97e4f0da4cdfd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c56332fbfac479b9424d32d20cd3a19"
23:48:01.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.546612  4362 raft_consensus.cc:3060] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.547034  5452 raft_consensus.cc:2804] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:01.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.547284  5452 raft_consensus.cc:493] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:01.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.547564  5452 raft_consensus.cc:3060] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.551311  5427 leader_election.cc:290] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 election: Requested vote from peers 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511), 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:48:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.551208  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80c95fd8a794a1cb78e9c76d2f2a6cc" candidate_uuid: "9460cad6b24b4916b63842f2742139a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c56332fbfac479b9424d32d20cd3a19" is_pre_election: true
23:48:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.551544  4361 raft_consensus.cc:2468] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9460cad6b24b4916b63842f2742139a2 in term 0.
23:48:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.551752  5452 raft_consensus.cc:515] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.551887  4362 raft_consensus.cc:2468] T adcf4679f475414d88d97e4f0da4cdfd P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 1.
23:48:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.552443  4571 leader_election.cc:304] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19df80ee04424f9dfce1f351ce4189, 9c56332fbfac479b9424d32d20cd3a19; no voters: 
23:48:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.552405  4433 leader_election.cc:304] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9460cad6b24b4916b63842f2742139a2, 9c56332fbfac479b9424d32d20cd3a19; no voters: 
23:48:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.552654  4640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80c95fd8a794a1cb78e9c76d2f2a6cc" candidate_uuid: "9460cad6b24b4916b63842f2742139a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19df80ee04424f9dfce1f351ce4189" is_pre_election: true
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.552887  4640 raft_consensus.cc:2468] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9460cad6b24b4916b63842f2742139a2 in term 0.
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.553032  5425 raft_consensus.cc:2804] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.553092  5452 leader_election.cc:290] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 election: Requested vote from peers 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511), 9460cad6b24b4916b63842f2742139a2 (127.3.230.194:45625)
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.553174  5425 raft_consensus.cc:493] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.553282  5425 raft_consensus.cc:3060] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.553290  5452 raft_consensus.cc:2804] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Leader election won for term 1
23:48:01.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.553462  5452 raft_consensus.cc:697] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [term 1 LEADER]: Becoming Leader. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Running, Role: LEADER
23:48:01.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.554107  4500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157534ed83945df9c51a974fa62d3dd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2"
23:48:01.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.554044  5452 consensus_queue.cc:237] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.554348  4500 raft_consensus.cc:3060] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.554138  4501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcf4679f475414d88d97e4f0da4cdfd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9460cad6b24b4916b63842f2742139a2"
23:48:01.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.556190  4501 raft_consensus.cc:3060] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.557607  4500 raft_consensus.cc:2468] T d157534ed83945df9c51a974fa62d3dd P 9460cad6b24b4916b63842f2742139a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 1.
23:48:01.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.558190  4573 leader_election.cc:304] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19df80ee04424f9dfce1f351ce4189, 9460cad6b24b4916b63842f2742139a2; no voters: 
23:48:01.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.558531  5427 raft_consensus.cc:2804] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Leader election won for term 1
23:48:01.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.562448  5425 raft_consensus.cc:515] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.565132  4640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80c95fd8a794a1cb78e9c76d2f2a6cc" candidate_uuid: "9460cad6b24b4916b63842f2742139a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d19df80ee04424f9dfce1f351ce4189"
23:48:01.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.565440  4640 raft_consensus.cc:3060] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.566504  4501 raft_consensus.cc:2468] T adcf4679f475414d88d97e4f0da4cdfd P 9460cad6b24b4916b63842f2742139a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 1.
23:48:01.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.567667  5425 leader_election.cc:290] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [CANDIDATE]: Term 1 election: Requested vote from peers 9c56332fbfac479b9424d32d20cd3a19 (127.3.230.193:42511), 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195:35473)
23:48:01.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.568123  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157534ed83945df9c51a974fa62d3dd" candidate_uuid: "8d19df80ee04424f9dfce1f351ce4189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c56332fbfac479b9424d32d20cd3a19"
23:48:01.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.568406  4362 raft_consensus.cc:3060] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.569564  4640 raft_consensus.cc:2468] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 8d19df80ee04424f9dfce1f351ce4189 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9460cad6b24b4916b63842f2742139a2 in term 1.
23:48:01.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.570137  4433 leader_election.cc:304] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d19df80ee04424f9dfce1f351ce4189, 9460cad6b24b4916b63842f2742139a2; no voters: 
23:48:01.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.570869  5425 raft_consensus.cc:2804] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 1 FOLLOWER]: Leader election won for term 1
23:48:01.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.571372  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80c95fd8a794a1cb78e9c76d2f2a6cc" candidate_uuid: "9460cad6b24b4916b63842f2742139a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c56332fbfac479b9424d32d20cd3a19"
23:48:01.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.571635  4361 raft_consensus.cc:3060] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [term 0 FOLLOWER]: Advancing to term 1
23:48:01.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.577222  4361 raft_consensus.cc:2468] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9460cad6b24b4916b63842f2742139a2 in term 1.
23:48:01.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.580058  4362 raft_consensus.cc:2468] T d157534ed83945df9c51a974fa62d3dd P 9c56332fbfac479b9424d32d20cd3a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d19df80ee04424f9dfce1f351ce4189 in term 1.
23:48:01.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.584079  5427 raft_consensus.cc:697] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [term 1 LEADER]: Becoming Leader. State: Replica: 8d19df80ee04424f9dfce1f351ce4189, State: Running, Role: LEADER
23:48:01.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.584662  5427 consensus_queue.cc:237] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.585922  4183 catalog_manager.cc:5696] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195). New cstate: current_term: 1 leader_uuid: "8d19df80ee04424f9dfce1f351ce4189" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } health_report { overall_health: HEALTHY } } }
23:48:01.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.599952  5425 raft_consensus.cc:697] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [term 1 LEADER]: Becoming Leader. State: Replica: 9460cad6b24b4916b63842f2742139a2, State: Running, Role: LEADER
23:48:01.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.601275  5425 consensus_queue.cc:237] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } }
23:48:01.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.602772  4183 catalog_manager.cc:5696] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d19df80ee04424f9dfce1f351ce4189 (127.3.230.195). New cstate: current_term: 1 leader_uuid: "8d19df80ee04424f9dfce1f351ce4189" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } health_report { overall_health: HEALTHY } } }
23:48:01.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.609086  4181 catalog_manager.cc:5696] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9460cad6b24b4916b63842f2742139a2 (127.3.230.194). New cstate: current_term: 1 leader_uuid: "9460cad6b24b4916b63842f2742139a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 } health_report { overall_health: UNKNOWN } } }
23:48:01.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468081667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:01.679 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:01.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
23:48:01.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.954339  5442 consensus_queue.cc:1048] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.963394  5443 consensus_queue.cc:1048] T 2abbce68bf9b4cc0b8028cafc59c9d59 P 9c56332fbfac479b9424d32d20cd3a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:01.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.969108  5427 consensus_queue.cc:1048] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:01.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.976526  5455 consensus_queue.cc:1048] T adcf4679f475414d88d97e4f0da4cdfd P 8d19df80ee04424f9dfce1f351ce4189 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:01.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.978447  5443 consensus_queue.cc:1048] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:01.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.988680  5386 heartbeater.cc:499] Master 127.4.149.252:44265 was elected leader, sending a full tablet report...
23:48:01.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:01.997339  5426 consensus_queue.cc:1048] T ad1717b59e6a4882bde027a3330b8294 P 9c56332fbfac479b9424d32d20cd3a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:02.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.031672  5425 consensus_queue.cc:1048] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:02.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.043308  5456 consensus_queue.cc:1048] T f80c95fd8a794a1cb78e9c76d2f2a6cc P 9460cad6b24b4916b63842f2742139a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d19df80ee04424f9dfce1f351ce4189" member_type: VOTER last_known_addr { host: "127.3.230.195" port: 35473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:02.099 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:02.106 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:02.107 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:02.107 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:02.107 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:02.107 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:02.107 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:02.108 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:02.110 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] Successfully connected to peer
23:48:02.123 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.127 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x473a61d9, L:/127.0.0.1:48840 - R:/127.3.230.195:35473] using TOKEN/null
23:48:02.151 [DEBUG - main] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:02.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.157850  5427 consensus_queue.cc:1048] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c56332fbfac479b9424d32d20cd3a19" member_type: VOTER last_known_addr { host: "127.3.230.193" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:02.167 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:02.169 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468082167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:02.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.171895  5455 consensus_queue.cc:1048] T d157534ed83945df9c51a974fa62d3dd P 8d19df80ee04424f9dfce1f351ce4189 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9460cad6b24b4916b63842f2742139a2" member_type: VOTER last_known_addr { host: "127.3.230.194" port: 45625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:02.183 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.186 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
23:48:02.189 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
23:48:02.192 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x974c8d34, L:/127.0.0.1:35372 - R:/127.3.230.193:42511] using TOKEN/null
23:48:02.209 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:02.209 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:02.209 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:02.209 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:02.210 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:02.210 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:02.210 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [3ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:02.237 [DEBUG - main] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:02.240 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] Successfully connected to peer
23:48:02.254 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.257 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x372c631f, L:/127.0.0.1:48990 - R:/127.3.230.194:45625] using TOKEN/null
23:48:02.327 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:02.329 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:02.330 [DEBUG - main] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:02.335 [DEBUG - main] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:02.336 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.149.252:44265(127.4.149.252:44265)] Successfully connected to peer
23:48:02.339 [DEBUG - main] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:02.339 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.252
23:48:02.347 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.149.253:38083(127.4.149.253:38083)] Successfully connected to peer
23:48:02.348 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.149.254:41393(127.4.149.254:41393)] Successfully connected to peer
23:48:02.353 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.359 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.253
23:48:02.359 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.254
23:48:02.359 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0e700bdd, L:/127.0.0.1:46728 - R:/127.4.149.252:44265] using SASL/PLAIN
23:48:02.362 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:02.362 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [31ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: OK, deferred=null) after lookup
23:48:02.371 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.371 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.373 [DEBUG - main] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:02.375 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x32a37170, L:/127.0.0.1:53748 - R:/127.4.149.254:41393] using SASL/PLAIN
23:48:02.375 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd52ff51b, L:/127.0.0.1:59396 - R:/127.4.149.253:38083] using SASL/PLAIN
23:48:02.383 [DEBUG - main] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:02.384 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:02.385 [DEBUG - main] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:02.386 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:02.386 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:02.388 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:02.391 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:02.398 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.398 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.254
23:48:02.401 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.402 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd90cf181, L:/127.0.0.1:54626 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:02.404 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb015c519, L:/127.0.0.1:49380 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:02.406 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:02.407 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=40), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [32ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [34ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:02.409 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:02.410 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:02.413 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1d091fd6, L:/127.0.0.1:48872 - R:/127.3.230.254:44025] using SASL/PLAIN
23:48:02.413 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:02.414 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:02.414 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:02.414 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:02.414 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:02.414 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:02.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.418342  4882 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46728:
23:48:02.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:02.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:02.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:48:02.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:02.422032  4882 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:02.449 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:02.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.509229  5043 tablet_service.cc:1511] Processing CreateTablet for tablet 94bc29aa63a540e49702b0e676cc0908 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.511075  5040 tablet_service.cc:1511] Processing CreateTablet for tablet a89203da901b4a1ab871fa5bd4b24010 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.511966  5040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89203da901b4a1ab871fa5bd4b24010. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.511996  5044 tablet_service.cc:1511] Processing CreateTablet for tablet bad2d40e1ed6408993080941c43ccc74 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.513310  5041 tablet_service.cc:1511] Processing CreateTablet for tablet d61998f73f2a49bdb444851539491fcb (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.515460  5041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61998f73f2a49bdb444851539491fcb. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.515628  5321 tablet_service.cc:1511] Processing CreateTablet for tablet bad2d40e1ed6408993080941c43ccc74 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.518014  5321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad2d40e1ed6408993080941c43ccc74. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.518546  5179 tablet_service.cc:1511] Processing CreateTablet for tablet d61998f73f2a49bdb444851539491fcb (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.519321  5180 tablet_service.cc:1511] Processing CreateTablet for tablet 3546ff67dddb42bb9d7ff65a7e827484 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.520023  5320 tablet_service.cc:1511] Processing CreateTablet for tablet 94bc29aa63a540e49702b0e676cc0908 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.520506  5179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61998f73f2a49bdb444851539491fcb. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.520519  5320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bc29aa63a540e49702b0e676cc0908. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.520628  5042 tablet_service.cc:1511] Processing CreateTablet for tablet 3546ff67dddb42bb9d7ff65a7e827484 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.517584  5178 tablet_service.cc:1511] Processing CreateTablet for tablet a89203da901b4a1ab871fa5bd4b24010 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.522094  5178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89203da901b4a1ab871fa5bd4b24010. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.523512  5319 tablet_service.cc:1511] Processing CreateTablet for tablet 3546ff67dddb42bb9d7ff65a7e827484 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.524047  5319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3546ff67dddb42bb9d7ff65a7e827484. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.525600  5182 tablet_service.cc:1511] Processing CreateTablet for tablet bad2d40e1ed6408993080941c43ccc74 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.526371  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad2d40e1ed6408993080941c43ccc74. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.528326  5042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3546ff67dddb42bb9d7ff65a7e827484. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.529193  5317 tablet_service.cc:1511] Processing CreateTablet for tablet a89203da901b4a1ab871fa5bd4b24010 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.529765  5317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89203da901b4a1ab871fa5bd4b24010. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.531316  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 94bc29aa63a540e49702b0e676cc0908 (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.536387  5318 tablet_service.cc:1511] Processing CreateTablet for tablet d61998f73f2a49bdb444851539491fcb (DEFAULT_TABLE table=replication_test_table [id=44e0d555aac84dc2a3a2eddc2e75501f]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:02.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.536947  5318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d61998f73f2a49bdb444851539491fcb. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.539433  5180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3546ff67dddb42bb9d7ff65a7e827484. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.542997  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bc29aa63a540e49702b0e676cc0908. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.555099  5043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bc29aa63a540e49702b0e676cc0908. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.557207  5518 tablet_bootstrap.cc:492] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79: Bootstrap starting.
23:48:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.561957  5518 tablet_bootstrap.cc:654] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79: Neither blocks nor log segments found. Creating new log.
23:48:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.562512  5044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad2d40e1ed6408993080941c43ccc74. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.563580  5518 log.cc:826] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79: Log is configured to *not* fsync() on all Append() calls
23:48:02.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.599195  5519 tablet_bootstrap.cc:492] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: Bootstrap starting.
23:48:02.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.603410  5519 tablet_bootstrap.cc:654] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: Neither blocks nor log segments found. Creating new log.
23:48:02.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.607738  5521 tablet_bootstrap.cc:492] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Bootstrap starting.
23:48:02.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.609587  5519 log.cc:826] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: Log is configured to *not* fsync() on all Append() calls
23:48:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.614176  5521 tablet_bootstrap.cc:654] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Neither blocks nor log segments found. Creating new log.
23:48:02.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.618006  5518 tablet_bootstrap.cc:492] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79: No bootstrap required, opened a new log
23:48:02.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.618412  5518 ts_tablet_manager.cc:1403] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79: Time spent bootstrapping tablet: real 0.062s	user 0.026s	sys 0.030s
23:48:02.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.619318  5519 tablet_bootstrap.cc:492] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: No bootstrap required, opened a new log
23:48:02.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.619743  5519 ts_tablet_manager.cc:1403] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.004s
23:48:02.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.620275  5521 log.cc:826] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Log is configured to *not* fsync() on all Append() calls
23:48:02.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.626287  5518 raft_consensus.cc:359] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.626775  5518 raft_consensus.cc:385] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.626929  5518 raft_consensus.cc:740] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Initialized, Role: FOLLOWER
23:48:02.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.628016  5518 consensus_queue.cc:260] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.628857  5519 raft_consensus.cc:359] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.629570  5519 raft_consensus.cc:385] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.629832  5519 raft_consensus.cc:740] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086235c2e9fa4599aedd1f42dea78812, State: Initialized, Role: FOLLOWER
23:48:02.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.630054  5521 tablet_bootstrap.cc:492] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: No bootstrap required, opened a new log
23:48:02.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.630369  5521 ts_tablet_manager.cc:1403] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
23:48:02.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.631172  5519 consensus_queue.cc:260] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.638352  5521 raft_consensus.cc:359] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.638873  5521 raft_consensus.cc:385] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.639001  5521 raft_consensus.cc:740] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64c2cb13f0c2407b9ebfcb431ccf83a9, State: Initialized, Role: FOLLOWER
23:48:02.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.640334  5518 ts_tablet_manager.cc:1434] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79: Time spent starting tablet: real 0.022s	user 0.017s	sys 0.005s
23:48:02.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.639803  5521 consensus_queue.cc:260] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.641054  5526 raft_consensus.cc:493] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:02.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.641870  5518 tablet_bootstrap.cc:492] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79: Bootstrap starting.
23:48:02.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.642889  5519 ts_tablet_manager.cc:1434] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.002s
23:48:02.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.644227  5518 tablet_bootstrap.cc:654] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79: Neither blocks nor log segments found. Creating new log.
23:48:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.646574  5521 ts_tablet_manager.cc:1434] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.007s
23:48:02.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.647050  5526 raft_consensus.cc:515] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.649472  5521 tablet_bootstrap.cc:492] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9: Bootstrap starting.
23:48:02.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.651651  5521 tablet_bootstrap.cc:654] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9: Neither blocks nor log segments found. Creating new log.
23:48:02.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.653829  5526 leader_election.cc:290] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.654572  5519 tablet_bootstrap.cc:492] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812: Bootstrap starting.
23:48:02.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.657433  5519 tablet_bootstrap.cc:654] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812: Neither blocks nor log segments found. Creating new log.
23:48:02.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.658526  5518 tablet_bootstrap.cc:492] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79: No bootstrap required, opened a new log
23:48:02.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.658860  5518 ts_tablet_manager.cc:1403] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.000s
23:48:02.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.660219  5518 raft_consensus.cc:359] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.660634  5518 raft_consensus.cc:385] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.660859  5518 raft_consensus.cc:740] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Initialized, Role: FOLLOWER
23:48:02.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.661239  5518 consensus_queue.cc:260] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.661983  5518 ts_tablet_manager.cc:1434] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:48:02.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.662422  5518 tablet_bootstrap.cc:492] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79: Bootstrap starting.
23:48:02.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.664616  5518 tablet_bootstrap.cc:654] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79: Neither blocks nor log segments found. Creating new log.
23:48:02.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468082668 for job bbc34d76ac15add629743db00c4f4a33.
23:48:02.699 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=29 ms, finalizationTime=2 ms).
23:48:02.704 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
23:48:02.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:02.706243  5393 tablet.cc:2406] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:02.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.715054  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89203da901b4a1ab871fa5bd4b24010" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812" is_pre_election: true
23:48:02.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:02.717279  4998 leader_election.cc:343] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185): Illegal state: must be running to vote when last-logged opid is not known
23:48:02.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.719712  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89203da901b4a1ab871fa5bd4b24010" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" is_pre_election: true
23:48:02.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.720463  5341 raft_consensus.cc:2468] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.721426  4999 leader_election.cc:304] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64c2cb13f0c2407b9ebfcb431ccf83a9, ce4de942beb74ff39c48ff0e7609df79; no voters: 086235c2e9fa4599aedd1f42dea78812
23:48:02.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.722472  5526 raft_consensus.cc:2804] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:02.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.722646  5526 raft_consensus.cc:493] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:02.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.722749  5526 raft_consensus.cc:3060] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.726506  5526 raft_consensus.cc:515] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.728183  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89203da901b4a1ab871fa5bd4b24010" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:02.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:02.729475  4998 leader_election.cc:343] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185): Illegal state: must be running to vote when last-logged opid is not known
23:48:02.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.730765  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89203da901b4a1ab871fa5bd4b24010" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:02.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.731055  5341 raft_consensus.cc:3060] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.734869  5526 leader_election.cc:290] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Requested vote from peers 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.736191  5341 raft_consensus.cc:2468] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.736904  4999 leader_election.cc:304] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 64c2cb13f0c2407b9ebfcb431ccf83a9, ce4de942beb74ff39c48ff0e7609df79; no voters: 086235c2e9fa4599aedd1f42dea78812
23:48:02.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.737632  5526 raft_consensus.cc:2804] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Leader election won for term 1
23:48:02.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.738289  5526 raft_consensus.cc:697] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [term 1 LEADER]: Becoming Leader. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Running, Role: LEADER
23:48:02.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.739006  5526 consensus_queue.cc:237] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.743988  5521 tablet_bootstrap.cc:492] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9: No bootstrap required, opened a new log
23:48:02.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.744516  5521 ts_tablet_manager.cc:1403] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.039s
23:48:02.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.746181  5521 raft_consensus.cc:359] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.746646  5521 raft_consensus.cc:385] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.746923  5521 raft_consensus.cc:740] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64c2cb13f0c2407b9ebfcb431ccf83a9, State: Initialized, Role: FOLLOWER
23:48:02.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.747398  5521 consensus_queue.cc:260] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.748164  5521 ts_tablet_manager.cc:1434] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
23:48:02.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.749150  5521 tablet_bootstrap.cc:492] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Bootstrap starting.
23:48:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.755621  5521 tablet_bootstrap.cc:654] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Neither blocks nor log segments found. Creating new log.
23:48:02.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.767347  5521 tablet_bootstrap.cc:492] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9: No bootstrap required, opened a new log
23:48:02.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.767580  5519 tablet_bootstrap.cc:492] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812: No bootstrap required, opened a new log
23:48:02.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.767750  5519 ts_tablet_manager.cc:1403] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.055s
23:48:02.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.768023  5518 tablet_bootstrap.cc:492] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79: No bootstrap required, opened a new log
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.768224  5518 ts_tablet_manager.cc:1403] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.021s
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769049  5519 raft_consensus.cc:359] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769126  5518 raft_consensus.cc:359] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769263  5519 raft_consensus.cc:385] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769340  5518 raft_consensus.cc:385] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769361  5519 raft_consensus.cc:740] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086235c2e9fa4599aedd1f42dea78812, State: Initialized, Role: FOLLOWER
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769419  5518 raft_consensus.cc:740] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Initialized, Role: FOLLOWER
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769634  5519 consensus_queue.cc:260] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.770780  5519 ts_tablet_manager.cc:1434] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.771126  5519 tablet_bootstrap.cc:492] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812: Bootstrap starting.
23:48:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.771044  4881 catalog_manager.cc:5696] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193). New cstate: current_term: 1 leader_uuid: "ce4de942beb74ff39c48ff0e7609df79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } health_report { overall_health: UNKNOWN } } }
23:48:02.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.771955  5521 ts_tablet_manager.cc:1403] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent bootstrapping tablet: real 0.023s	user 0.001s	sys 0.007s
23:48:02.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.772835  5521 raft_consensus.cc:359] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.773119  5519 tablet_bootstrap.cc:654] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812: Neither blocks nor log segments found. Creating new log.
23:48:02.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.773206  5521 raft_consensus.cc:385] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.773283  5521 raft_consensus.cc:740] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64c2cb13f0c2407b9ebfcb431ccf83a9, State: Initialized, Role: FOLLOWER
23:48:02.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.773577  5521 consensus_queue.cc:260] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.774197  5521 ts_tablet_manager.cc:1434] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.001s
23:48:02.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.774621  5521 tablet_bootstrap.cc:492] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Bootstrap starting.
23:48:02.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.777592  5521 tablet_bootstrap.cc:654] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Neither blocks nor log segments found. Creating new log.
23:48:02.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.788328  5519 tablet_bootstrap.cc:492] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812: No bootstrap required, opened a new log
23:48:02.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.789466  5519 ts_tablet_manager.cc:1403] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
23:48:02.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.790506  5519 raft_consensus.cc:359] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.790931  5521 tablet_bootstrap.cc:492] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9: No bootstrap required, opened a new log
23:48:02.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.791122  5521 ts_tablet_manager.cc:1403] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
23:48:02.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.769869  5518 consensus_queue.cc:260] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.792021  5521 raft_consensus.cc:359] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.792224  5521 raft_consensus.cc:385] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.792326  5521 raft_consensus.cc:740] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64c2cb13f0c2407b9ebfcb431ccf83a9, State: Initialized, Role: FOLLOWER
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.792582  5519 raft_consensus.cc:385] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.792680  5519 raft_consensus.cc:740] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086235c2e9fa4599aedd1f42dea78812, State: Initialized, Role: FOLLOWER
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.792936  5519 consensus_queue.cc:260] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.793548  5519 ts_tablet_manager.cc:1434] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.001s
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.793896  5519 tablet_bootstrap.cc:492] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812: Bootstrap starting.
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.795030  5518 ts_tablet_manager.cc:1434] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.001s
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.794958  5521 consensus_queue.cc:260] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.797209  5521 ts_tablet_manager.cc:1434] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.797523  5521 tablet_bootstrap.cc:492] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Bootstrap starting.
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.798252  5518 tablet_bootstrap.cc:492] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79: Bootstrap starting.
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.800839  5519 tablet_bootstrap.cc:654] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812: Neither blocks nor log segments found. Creating new log.
23:48:02.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.801913  5521 tablet_bootstrap.cc:654] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Neither blocks nor log segments found. Creating new log.
23:48:02.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.805646  5518 tablet_bootstrap.cc:654] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79: Neither blocks nor log segments found. Creating new log.
23:48:02.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.810447  5521 tablet_bootstrap.cc:492] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9: No bootstrap required, opened a new log
23:48:02.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.810667  5521 ts_tablet_manager.cc:1403] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
23:48:02.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.811133  5518 tablet_bootstrap.cc:492] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79: No bootstrap required, opened a new log
23:48:02.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.811311  5518 ts_tablet_manager.cc:1403] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.001s
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.811512  5521 raft_consensus.cc:359] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.811753  5521 raft_consensus.cc:385] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.811847  5521 raft_consensus.cc:740] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64c2cb13f0c2407b9ebfcb431ccf83a9, State: Initialized, Role: FOLLOWER
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.812119  5521 consensus_queue.cc:260] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.812493  5518 raft_consensus.cc:359] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.812752  5518 raft_consensus.cc:385] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.812883  5518 raft_consensus.cc:740] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Initialized, Role: FOLLOWER
23:48:02.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.813563  5518 consensus_queue.cc:260] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.814117  5518 ts_tablet_manager.cc:1434] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:48:02.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.814690  5521 ts_tablet_manager.cc:1434] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
23:48:02.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.817767  5519 tablet_bootstrap.cc:492] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812: No bootstrap required, opened a new log
23:48:02.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.818099  5519 ts_tablet_manager.cc:1403] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.000s
23:48:02.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.819384  5519 raft_consensus.cc:359] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.819770  5519 raft_consensus.cc:385] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.820050  5519 raft_consensus.cc:740] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086235c2e9fa4599aedd1f42dea78812, State: Initialized, Role: FOLLOWER
23:48:02.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.820744  5519 consensus_queue.cc:260] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.821805  5519 ts_tablet_manager.cc:1434] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:48:02.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.822057  5518 tablet_bootstrap.cc:492] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79: Bootstrap starting.
23:48:02.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.824260  5518 tablet_bootstrap.cc:654] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79: Neither blocks nor log segments found. Creating new log.
23:48:02.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.826517  5519 tablet_bootstrap.cc:492] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812: Bootstrap starting.
23:48:02.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.828624  5519 tablet_bootstrap.cc:654] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812: Neither blocks nor log segments found. Creating new log.
23:48:02.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:02.832845  5116 tablet.cc:2406] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:02.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.835894  5518 tablet_bootstrap.cc:492] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79: No bootstrap required, opened a new log
23:48:02.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.836107  5518 ts_tablet_manager.cc:1403] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.005s
23:48:02.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.837028  5519 tablet_bootstrap.cc:492] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812: No bootstrap required, opened a new log
23:48:02.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.837028  5518 raft_consensus.cc:359] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.837216  5519 ts_tablet_manager.cc:1403] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812: Time spent bootstrapping tablet: real 0.011s	user 0.002s	sys 0.004s
23:48:02.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.837249  5518 raft_consensus.cc:385] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.837321  5518 raft_consensus.cc:740] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Initialized, Role: FOLLOWER
23:48:02.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.837610  5518 consensus_queue.cc:260] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.838024  5519 raft_consensus.cc:359] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.838229  5519 raft_consensus.cc:385] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:02.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.838310  5519 raft_consensus.cc:740] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086235c2e9fa4599aedd1f42dea78812, State: Initialized, Role: FOLLOWER
23:48:02.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.838598  5519 consensus_queue.cc:260] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.839125  5519 ts_tablet_manager.cc:1434] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:02.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.839386  5518 ts_tablet_manager.cc:1434] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
23:48:02.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.840817  5526 raft_consensus.cc:493] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.841017  5526 raft_consensus.cc:515] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.841755  5526 leader_election.cc:290] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.842324  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61998f73f2a49bdb444851539491fcb" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" is_pre_election: true
23:48:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.842576  5341 raft_consensus.cc:2468] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.843118  4999 leader_election.cc:304] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64c2cb13f0c2407b9ebfcb431ccf83a9, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.843559  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61998f73f2a49bdb444851539491fcb" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812" is_pre_election: true
23:48:02.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.843909  5203 raft_consensus.cc:2468] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.845382  5526 raft_consensus.cc:2804] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:02.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.845513  5526 raft_consensus.cc:493] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:02.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.845634  5526 raft_consensus.cc:3060] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.847774  5526 raft_consensus.cc:515] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.848448  5526 leader_election.cc:290] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Requested vote from peers 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.848871  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61998f73f2a49bdb444851539491fcb" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:02.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.849116  5203 raft_consensus.cc:3060] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.849135  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d61998f73f2a49bdb444851539491fcb" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:02.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.849395  5341 raft_consensus.cc:3060] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.852002  5203 raft_consensus.cc:2468] T d61998f73f2a49bdb444851539491fcb P 086235c2e9fa4599aedd1f42dea78812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.852530  5341 raft_consensus.cc:2468] T d61998f73f2a49bdb444851539491fcb P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.852571  4998 leader_election.cc:304] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086235c2e9fa4599aedd1f42dea78812, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.852963  5526 raft_consensus.cc:2804] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Leader election won for term 1
23:48:02.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.853732  5526 raft_consensus.cc:697] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [term 1 LEADER]: Becoming Leader. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Running, Role: LEADER
23:48:02.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.853997  5526 consensus_queue.cc:237] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.857409  4882 catalog_manager.cc:5696] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193). New cstate: current_term: 1 leader_uuid: "ce4de942beb74ff39c48ff0e7609df79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } health_report { overall_health: UNKNOWN } } }
23:48:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.860527  5526 raft_consensus.cc:493] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:02.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.861853  5526 raft_consensus.cc:515] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.864827  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2d40e1ed6408993080941c43ccc74" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" is_pre_election: true
23:48:02.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.865037  5341 raft_consensus.cc:2468] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.865581  5526 leader_election.cc:290] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019), 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185)
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.865650  4999 leader_election.cc:304] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64c2cb13f0c2407b9ebfcb431ccf83a9, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:02.865909  5258 tablet.cc:2406] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.866047  5524 raft_consensus.cc:2804] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.866150  5524 raft_consensus.cc:493] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.866086  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2d40e1ed6408993080941c43ccc74" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812" is_pre_election: true
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.866250  5524 raft_consensus.cc:3060] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.866336  5203 raft_consensus.cc:2468] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.869313  5524 raft_consensus.cc:515] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.870151  5524 leader_election.cc:290] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Requested vote from peers 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019), 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185)
23:48:02.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.870642  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2d40e1ed6408993080941c43ccc74" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:02.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.871063  5203 raft_consensus.cc:3060] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.870954  5525 raft_consensus.cc:493] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:02.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.871294  5525 raft_consensus.cc:515] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.871591  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2d40e1ed6408993080941c43ccc74" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:02.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.871802  5341 raft_consensus.cc:3060] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.873420  5203 raft_consensus.cc:2468] T bad2d40e1ed6408993080941c43ccc74 P 086235c2e9fa4599aedd1f42dea78812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.873960  5525 leader_election.cc:290] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193:36799), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.875620  4998 leader_election.cc:304] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086235c2e9fa4599aedd1f42dea78812, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.876792  5524 raft_consensus.cc:2804] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Leader election won for term 1
23:48:02.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.876964  5524 raft_consensus.cc:697] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [term 1 LEADER]: Becoming Leader. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Running, Role: LEADER
23:48:02.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.877287  5524 consensus_queue.cc:237] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } }
23:48:02.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.877583  5341 raft_consensus.cc:2468] T bad2d40e1ed6408993080941c43ccc74 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.882313  5525 raft_consensus.cc:493] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:02.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.882510  5525 raft_consensus.cc:515] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.883275  5525 leader_election.cc:290] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193:36799), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.883747  5526 raft_consensus.cc:493] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:02.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.883980  5526 raft_consensus.cc:515] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.884153  5064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3546ff67dddb42bb9d7ff65a7e827484" candidate_uuid: "086235c2e9fa4599aedd1f42dea78812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4de942beb74ff39c48ff0e7609df79" is_pre_election: true
23:48:02.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.884577  5064 raft_consensus.cc:2468] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 086235c2e9fa4599aedd1f42dea78812 in term 0.
23:48:02.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.884895  5526 leader_election.cc:290] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886040  5137 leader_election.cc:304] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086235c2e9fa4599aedd1f42dea78812, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886246  5064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89203da901b4a1ab871fa5bd4b24010" candidate_uuid: "086235c2e9fa4599aedd1f42dea78812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4de942beb74ff39c48ff0e7609df79" is_pre_election: true
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886224  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc29aa63a540e49702b0e676cc0908" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" is_pre_election: true
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886500  5341 raft_consensus.cc:2468] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886626  5525 raft_consensus.cc:2804] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886751  5525 raft_consensus.cc:493] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.886929  5525 raft_consensus.cc:3060] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.887068  4999 leader_election.cc:304] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64c2cb13f0c2407b9ebfcb431ccf83a9, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.887367  5526 raft_consensus.cc:2804] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.887485  5526 raft_consensus.cc:493] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.887609  5526 raft_consensus.cc:3060] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.889405  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc29aa63a540e49702b0e676cc0908" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812" is_pre_election: true
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.889640  5203 raft_consensus.cc:2468] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 0.
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.891409  5525 raft_consensus.cc:515] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.891569  5526 raft_consensus.cc:515] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.892957  5203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc29aa63a540e49702b0e676cc0908" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086235c2e9fa4599aedd1f42dea78812"
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.892988  5064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3546ff67dddb42bb9d7ff65a7e827484" candidate_uuid: "086235c2e9fa4599aedd1f42dea78812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4de942beb74ff39c48ff0e7609df79"
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.893189  5203 raft_consensus.cc:3060] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.893227  5064 raft_consensus.cc:3060] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.897032  5525 leader_election.cc:290] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [CANDIDATE]: Term 1 election: Requested vote from peers ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193:36799), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.897068  4882 catalog_manager.cc:5696] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193). New cstate: current_term: 1 leader_uuid: "ce4de942beb74ff39c48ff0e7609df79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } health_report { overall_health: HEALTHY } } }
23:48:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.896531  5064 raft_consensus.cc:2468] T 3546ff67dddb42bb9d7ff65a7e827484 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 086235c2e9fa4599aedd1f42dea78812 in term 1.
23:48:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.898504  5137 leader_election.cc:304] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086235c2e9fa4599aedd1f42dea78812, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.898902  5525 raft_consensus.cc:2804] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 1 FOLLOWER]: Leader election won for term 1
23:48:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.898944  5341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3546ff67dddb42bb9d7ff65a7e827484" candidate_uuid: "086235c2e9fa4599aedd1f42dea78812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" is_pre_election: true
23:48:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.899191  5341 raft_consensus.cc:2468] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 086235c2e9fa4599aedd1f42dea78812 in term 0.
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.899677  5525 raft_consensus.cc:697] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [term 1 LEADER]: Becoming Leader. State: Replica: 086235c2e9fa4599aedd1f42dea78812, State: Running, Role: LEADER
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.900115  5340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89203da901b4a1ab871fa5bd4b24010" candidate_uuid: "086235c2e9fa4599aedd1f42dea78812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" is_pre_election: true
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.900549  5340 raft_consensus.cc:2393] T a89203da901b4a1ab871fa5bd4b24010 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 086235c2e9fa4599aedd1f42dea78812 in current term 1: Already voted for candidate ce4de942beb74ff39c48ff0e7609df79 in this term.
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.900398  5525 consensus_queue.cc:237] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.901075  5339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3546ff67dddb42bb9d7ff65a7e827484" candidate_uuid: "086235c2e9fa4599aedd1f42dea78812" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.901309  5203 raft_consensus.cc:2468] T 94bc29aa63a540e49702b0e676cc0908 P 086235c2e9fa4599aedd1f42dea78812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.901352  5339 raft_consensus.cc:3060] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.901829  5526 leader_election.cc:290] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Requested vote from peers 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194:34185), 64c2cb13f0c2407b9ebfcb431ccf83a9 (127.4.149.195:44019)
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.901898  4998 leader_election.cc:304] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086235c2e9fa4599aedd1f42dea78812, ce4de942beb74ff39c48ff0e7609df79; no voters: 
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.902201  5526 raft_consensus.cc:2804] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 1 FOLLOWER]: Leader election won for term 1
23:48:02.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.902354  5526 raft_consensus.cc:697] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [term 1 LEADER]: Becoming Leader. State: Replica: ce4de942beb74ff39c48ff0e7609df79, State: Running, Role: LEADER
23:48:02.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.902612  5526 consensus_queue.cc:237] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } }
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.904789  5339 raft_consensus.cc:2468] T 3546ff67dddb42bb9d7ff65a7e827484 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 086235c2e9fa4599aedd1f42dea78812 in term 1.
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.906050  5339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bc29aa63a540e49702b0e676cc0908" candidate_uuid: "ce4de942beb74ff39c48ff0e7609df79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9"
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.906334  5339 raft_consensus.cc:3060] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.908494  5136 leader_election.cc:304] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 086235c2e9fa4599aedd1f42dea78812; no voters: 64c2cb13f0c2407b9ebfcb431ccf83a9, ce4de942beb74ff39c48ff0e7609df79
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.908872  5552 raft_consensus.cc:3060] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 0 FOLLOWER]: Advancing to term 1
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.912537  5552 raft_consensus.cc:2749] T a89203da901b4a1ab871fa5bd4b24010 P 086235c2e9fa4599aedd1f42dea78812 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:48:02.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.913228  5339 raft_consensus.cc:2468] T 94bc29aa63a540e49702b0e676cc0908 P 64c2cb13f0c2407b9ebfcb431ccf83a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce4de942beb74ff39c48ff0e7609df79 in term 1.
23:48:02.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.919647  4882 catalog_manager.cc:5696] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 reported cstate change: term changed from 0 to 1, leader changed from <none> to 086235c2e9fa4599aedd1f42dea78812 (127.4.149.194). New cstate: current_term: 1 leader_uuid: "086235c2e9fa4599aedd1f42dea78812" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } health_report { overall_health: UNKNOWN } } }
23:48:02.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:02.921011  4880 catalog_manager.cc:5696] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce4de942beb74ff39c48ff0e7609df79 (127.4.149.193). New cstate: current_term: 1 leader_uuid: "ce4de942beb74ff39c48ff0e7609df79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 } health_report { overall_health: UNKNOWN } } }
23:48:03.073 [DEBUG - main] (Connection.java:575) [peer master-127.3.230.254:44025(127.3.230.254:44025)] disconnecting while in state READY
23:48:03.073 [DEBUG - main] (Connection.java:575) [peer master-127.3.230.252:37691(127.3.230.252:37691)] disconnecting while in state READY
23:48:03.073 [DEBUG - main] (Connection.java:575) [peer master-127.3.230.253:41003(127.3.230.253:41003)] disconnecting while in state READY
23:48:03.074 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:03.074 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state READY due to: connection closed
23:48:03.075 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:03.075 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:03.075 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:03.077 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
23:48:03.077 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
23:48:03.079 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:03.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:03.079 [DEBUG - main] (Connection.java:575) [peer master-127.4.149.252:44265(127.4.149.252:44265)] disconnecting while in state READY
23:48:03.079 [DEBUG - main] (Connection.java:575) [peer master-127.4.149.253:38083(127.4.149.253:38083)] disconnecting while in state READY
23:48:03.079 [DEBUG - main] (Connection.java:575) [peer master-127.4.149.254:41393(127.4.149.254:41393)] disconnecting while in state READY
23:48:03.080 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:03.080 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.149.252:44265(127.4.149.252:44265)] handling channelInactive
23:48:03.080 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.149.254:41393(127.4.149.254:41393)] handling channelInactive
23:48:03.080 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state READY due to: connection closed
23:48:03.081 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:03.081 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state READY due to: connection closed
23:48:03.082 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:48:03.082 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
23:48:03.083 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.149.253:38083(127.4.149.253:38083)] handling channelInactive
23:48:03.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state READY due to: connection closed
23:48:03.084 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
23:48:03.085 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:03.086 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:48:03.086 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:48:03.086 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:03.086 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:03.086 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:03.097 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:48:03.097 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:03.097 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:03.097 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:48:03.097 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:48:03.097 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:48:03.097 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:48:03.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468083167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:03.179 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:03.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
23:48:03.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.248710  5526 consensus_queue.cc:1048] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.264850  5524 consensus_queue.cc:1048] T a89203da901b4a1ab871fa5bd4b24010 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.275563  5524 consensus_queue.cc:1048] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.290990  5566 consensus_queue.cc:1048] T bad2d40e1ed6408993080941c43ccc74 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.340 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:48:03.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.377620  5566 consensus_queue.cc:1048] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.388340  5571 consensus_queue.cc:1048] T 94bc29aa63a540e49702b0e676cc0908 P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.406 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:48:03.406 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:48:03.406 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:48:03.420 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:03.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.447064  5571 consensus_queue.cc:1048] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.458086  5524 consensus_queue.cc:1048] T d61998f73f2a49bdb444851539491fcb P ce4de942beb74ff39c48ff0e7609df79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "086235c2e9fa4599aedd1f42dea78812" member_type: VOTER last_known_addr { host: "127.4.149.194" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.479 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:03.479 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:03.480 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:03.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:03.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:03.480 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:03.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:03.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:03.481 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:03.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:03.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:03.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:03.481 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:03.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.488844  5525 consensus_queue.cc:1048] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64c2cb13f0c2407b9ebfcb431ccf83a9" member_type: VOTER last_known_addr { host: "127.4.149.195" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:03.496166  5552 consensus_queue.cc:1048] T 3546ff67dddb42bb9d7ff65a7e827484 P 086235c2e9fa4599aedd1f42dea78812 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce4de942beb74ff39c48ff0e7609df79" member_type: VOTER last_known_addr { host: "127.4.149.193" port: 36799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:03.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468083667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:03.682 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:03.683 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
23:48:04.088 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:04.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468084167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:04.179 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:04.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
23:48:04.245 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:48:04.260 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:04.282 [INFO - flink-metrics-6] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:04.298 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:48:04.318 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:48:04.325 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:48:04.326 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:48:04.326 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:48:04.327 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:48:04.327 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:48:04.327 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:48:04.328 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:48:04.328 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:04.328 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:04.329 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:04.329 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:04.329 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:04.329 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:04.329 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:48:04.329 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:48:04.329 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:48:04.329 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:48:04.329 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:48:04.329 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:04.330 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:04.330 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:04.331 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:04.331 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:04.331 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:04.331 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_ff6831f2bdd42ce07a21df84108e60b8/blobStorage
23:48:04.332 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:43277 - max concurrent requests: 50 - max backlog: 1000
23:48:04.333 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_ff6831f2bdd42ce07a21df84108e60b8/blobStorage
23:48:04.334 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_ff6831f2bdd42ce07a21df84108e60b8/blobStorage
23:48:04.334 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:48:04.335 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 6a4ff6de-0b40-443a-bf4f-80ffab5e2470
23:48:04.337 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:48:04.337 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-2a7e1eff-01cc-40ac-a993-cf36afa7f77f
23:48:04.339 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-dc185468-5706-4838-b07c-e4919e6ab0be
23:48:04.402 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:48:04.402 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:48:04.402 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:48:04.402 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:48:04.403 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:48:04.405 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_4 .
23:48:04.412 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
23:48:04.412 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-51a32414-b2fc-4c1c-aab2-b9ec5e5988e4
23:48:04.412 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:48:04.413 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:48:04.421 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:48:04.421 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:48:04.427 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:33959
23:48:04.428 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:48:04.428 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:33959 was granted leadership with leaderSessionID=9d2997f6-81eb-4240-9eee-a33c372a643f
23:48:04.429 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:33959 , session=9d2997f6-81eb-4240-9eee-a33c372a643f
23:48:04.429 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:48:04.430 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:48:04.430 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:48:04.430 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 721926fc-be18-49bf-aa73-29a66e590f64. Creating new DispatcherLeaderProcess.
23:48:04.430 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:48:04.435 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:48:04.435 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:48:04.436 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:48:04.437 [INFO - pool-43-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id bda02540-cbea-4525-9840-674ee1da48ae.
23:48:04.438 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_5 .
23:48:04.440 [INFO - pool-43-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_6 .
23:48:04.446 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
23:48:04.447 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:48:04.447 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:48:04.448 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:48:04.448 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:48:04.448 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_6 , session=bda02540-cbea-4525-9840-674ee1da48ae
23:48:04.449 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_5 , session=721926fc-be18-49bf-aa73-29a66e590f64
23:48:04.450 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(9840674ee1da48aebda02540cbea4525).
23:48:04.487 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:04.495 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 (pekko://flink/user/rpc/taskmanager_4) at ResourceManager
23:48:04.495 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (6446e0085b210020482ce7a622d23630).
23:48:04.496 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_6 under registration id 2095bcee2ea0da503eef353992c215ea.
23:48:04.496 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (6446e0085b210020482ce7a622d23630).
23:48:04.496 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:344) Registering task executor 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 under 2095bcee2ea0da503eef353992c215ea at the slot manager.
23:48:04.496 [INFO - flink-pekko.actor.default-dispatcher-9] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-6446e0085b210020482ce7a622d23630'.
23:48:04.496 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 6446e0085b210020482ce7a622d23630 was granted leadership with leader id 7e6b6d2c-ded0-4750-8024-1d2fcbd9a12b. Creating new JobMasterServiceProcess.
23:48:04.501 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_7 .
23:48:04.507 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (6446e0085b210020482ce7a622d23630).
23:48:04.509 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (6446e0085b210020482ce7a622d23630).
23:48:04.510 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 838373697f00655c0fc7c46e22519c43 for job 6446e0085b210020482ce7a622d23630.
23:48:04.510 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (6446e0085b210020482ce7a622d23630).
23:48:04.511 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:48:04.512 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
23:48:04.512 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16ff77f6
23:48:04.513 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:04.513 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:04.514 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:48:04.515 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@233e7448 for Flink Streaming Job (6446e0085b210020482ce7a622d23630).
23:48:04.516 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (6446e0085b210020482ce7a622d23630) under job master id 80241d2fcbd9a12b7e6b6d2cded04750.
23:48:04.516 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:48:04.518 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_7 , session=7e6b6d2c-ded0-4750-8024-1d2fcbd9a12b
23:48:04.519 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.520 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:48:04.520 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state CREATED to RUNNING.
23:48:04.521 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:48:04.521 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:04.522 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:48:04.522 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:48:04.523 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:48:04.523 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:04.523 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(9840674ee1da48aebda02540cbea4525)
23:48:04.525 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:04.526 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager 80241d2fcbd9a12b7e6b6d2cded04750@pekko://flink/user/rpc/jobmanager_7 for job 6446e0085b210020482ce7a622d23630.
23:48:04.531 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:04.531 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager 80241d2fcbd9a12b7e6b6d2cded04750@pekko://flink/user/rpc/jobmanager_7 for job 6446e0085b210020482ce7a622d23630.
23:48:04.538 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:04.539 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:04.547 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:04.550 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:04.550 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.254
23:48:04.559 [DEBUG - main] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:04.562 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:04.562 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 9840674ee1da48aebda02540cbea4525.
23:48:04.563 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:04.564 [DEBUG - main] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:04.566 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.149.252:44265(127.4.149.252:44265)] Successfully connected to peer
23:48:04.569 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.571 [DEBUG - main] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:04.572 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.149.253:38083(127.4.149.253:38083)] Successfully connected to peer
23:48:04.575 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7ef86658, L:/127.0.0.1:54630 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:04.580 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.615 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.253
23:48:04.615 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.618 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.149.254:41393(127.4.149.254:41393)] Successfully connected to peer
23:48:04.619 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.252
23:48:04.620 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x33cef677, L:/127.0.0.1:48878 - R:/127.3.230.254:44025] using SASL/PLAIN
23:48:04.592 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:04.622 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xcf8aadc1, L:/127.0.0.1:49388 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:04.625 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:04.625 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=104), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:04.628 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:04.632 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 6446e0085b210020482ce7a622d23630
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 6a4ff6de-0b40-443a-bf4f-80ffab5e2470
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:48:04.634 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 9eb4051c1a4055e19a4fd12d5e8e0fbb from 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 for job 6446e0085b210020482ce7a622d23630 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.635 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 9eb4051c1a4055e19a4fd12d5e8e0fbb for job 6446e0085b210020482ce7a622d23630 from resource manager with leader id 9840674ee1da48aebda02540cbea4525.
23:48:04.635 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 9eb4051c1a4055e19a4fd12d5e8e0fbb with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.637 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot be7a18e0c9338df241a38b6571839023 from 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 for job 6446e0085b210020482ce7a622d23630 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.637 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 2750b63c4d5504ec57bd2f23b98fae74 from 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 for job 6446e0085b210020482ce7a622d23630 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.638 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot dc06bb8446b4d03ecd66cf0d840502e8 from 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 for job 6446e0085b210020482ce7a622d23630 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:04.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:04.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:04.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:04.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:04.640 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:04.648 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:192) Add job 6446e0085b210020482ce7a622d23630 for job leader monitoring.
23:48:04.648 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request be7a18e0c9338df241a38b6571839023 for job 6446e0085b210020482ce7a622d23630 from resource manager with leader id 9840674ee1da48aebda02540cbea4525.
23:48:04.648 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for be7a18e0c9338df241a38b6571839023 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.649 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 2750b63c4d5504ec57bd2f23b98fae74 for job 6446e0085b210020482ce7a622d23630 from resource manager with leader id 9840674ee1da48aebda02540cbea4525.
23:48:04.649 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 2750b63c4d5504ec57bd2f23b98fae74 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.649 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request dc06bb8446b4d03ecd66cf0d840502e8 for job 6446e0085b210020482ce7a622d23630 from resource manager with leader id 9840674ee1da48aebda02540cbea4525.
23:48:04.649 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for dc06bb8446b4d03ecd66cf0d840502e8 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:04.650 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.651 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.651 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_7 with leader id 7e6b6d2c-ded0-4750-8024-1d2fcbd9a12b.
23:48:04.653 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:48:04.655 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe593a430, L:/127.0.0.1:46740 - R:/127.4.149.252:44265] using SASL/PLAIN
23:48:04.657 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_7 for job 6446e0085b210020482ce7a622d23630.
23:48:04.657 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job 6446e0085b210020482ce7a622d23630.
23:48:04.657 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6446e0085b210020482ce7a622d23630.
23:48:04.658 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:04.658 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=100), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: OK, deferred=null) after lookup
23:48:04.658 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbc2de21f, L:/127.0.0.1:59400 - R:/127.4.149.253:38083] using SASL/PLAIN
23:48:04.658 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.254
23:48:04.659 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:48:04.660 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id 2750b63c4d5504ec57bd2f23b98fae74
23:48:04.661 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2750b63c4d5504ec57bd2f23b98fae74.
23:48:04.661 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:48:04.661 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id be7a18e0c9338df241a38b6571839023
23:48:04.662 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 6446e0085b210020482ce7a622d23630.
23:48:04.662 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:48:04.662 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 6446e0085b210020482ce7a622d23630
23:48:04.663 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 2750b63c4d5504ec57bd2f23b98fae74.
23:48:04.665 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.667 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468084668 for job bbc34d76ac15add629743db00c4f4a33.
23:48:04.669 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bad2d40e1ed6408993080941c43ccc74 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:04.670 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 94bc29aa63a540e49702b0e676cc0908 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:04.670 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9c6d5b13, L:/127.0.0.1:53760 - R:/127.4.149.254:41393] using SASL/PLAIN
23:48:04.670 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:04.670 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:04.671 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:04.671 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=bad2d40e1ed6408993080941c43ccc74@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=94bc29aa63a540e49702b0e676cc0908@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:04.671 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.149.252:44265, [4ms] Sub RPC GetTableLocations: received response from server master-127.4.149.252:44265: OK, deferred=null)) after lookup
23:48:04.672 [DEBUG - kudu-nio-0] (Connection.java:748) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] connecting to peer
23:48:04.673 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:48:04.673 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id 9eb4051c1a4055e19a4fd12d5e8e0fbb
23:48:04.677 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:48:04.677 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id dc06bb8446b4d03ecd66cf0d840502e8
23:48:04.679 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot be7a18e0c9338df241a38b6571839023.
23:48:04.679 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:48:04.679 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:48:04.681 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60cefb25
23:48:04.681 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id be7a18e0c9338df241a38b6571839023.
23:48:04.682 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:04.682 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:04.682 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:04.683 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:04.683 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:04.685 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
23:48:04.686 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] Successfully connected to peer
23:48:04.686 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:48:04.690 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:48:04.691 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2750b63c4d5504ec57bd2f23b98fae74.
23:48:04.691 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot be7a18e0c9338df241a38b6571839023.
23:48:04.691 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:48:04.691 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot dc06bb8446b4d03ecd66cf0d840502e8.
23:48:04.691 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot dc06bb8446b4d03ecd66cf0d840502e8.
23:48:04.696 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:48:04.696 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:48:04.696 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:48:04.696 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:48:04.697 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@355573f0
23:48:04.697 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:04.697 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:04.698 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:04.698 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:04.700 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id dc06bb8446b4d03ecd66cf0d840502e8.
23:48:04.701 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f3aacff
23:48:04.701 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:04.701 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:04.703 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:48:04.703 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:48:04.704 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f4f16ee
23:48:04.704 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@76c93bd0
23:48:04.704 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:04.704 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:04.705 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:04.707 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:04.709 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66b678da
23:48:04.710 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.710 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:04.711 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:04.711 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@441416b4
23:48:04.714 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.715 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:04.717 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.719 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:04.720 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:04.723 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.149.252:44265(127.4.149.252:44265)] Successfully connected to peer
23:48:04.723 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@512314eb
23:48:04.725 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.252
23:48:04.725 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.727 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:04.728 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.149.253:38083(127.4.149.253:38083)] Successfully connected to peer
23:48:04.733 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.734 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.253
23:48:04.739 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x80af67fd, L:/127.0.0.1:37748 - R:/127.4.149.193:36799] using TOKEN/null
23:48:04.742 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.149.254:41393(127.4.149.254:41393)] Successfully connected to peer
23:48:04.745 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.254
23:48:04.747 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.748 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:04.748 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.748 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:04.754 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.754 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:04.755 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x99055bd3, L:/127.0.0.1:46756 - R:/127.4.149.252:44265] using SASL/PLAIN
23:48:04.755 [DEBUG - main] (Connection.java:748) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] connecting to peer
23:48:04.759 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.759 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:04.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=45), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: OK, deferred=null) after lookup
23:48:04.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:04.764 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x234fafbb, L:/127.0.0.1:59410 - R:/127.4.149.253:38083] using SASL/PLAIN
23:48:04.765 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:04.767 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.149.252:44265(127.4.149.252:44265)] Successfully connected to peer
23:48:04.768 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:04.768 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.769 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.252
23:48:04.771 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.771 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.149.253:38083(127.4.149.253:38083)] Successfully connected to peer
23:48:04.772 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f5c079a
23:48:04.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:48:04.774 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:48:04.774 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.775 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.253
23:48:04.778 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.149.254:41393(127.4.149.254:41393)] Successfully connected to peer
23:48:04.782 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:04.792 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.149.252:44265(127.4.149.252:44265)] Successfully connected to peer
23:48:04.794 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.797 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0ce93a4b, L:/127.0.0.1:53774 - R:/127.4.149.254:41393] using SASL/PLAIN
23:48:04.797 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.798 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.254
23:48:04.807 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xec1d7baa, L:/127.0.0.1:46758 - R:/127.4.149.252:44265] using SASL/PLAIN
23:48:04.808 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:04.810 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.252
23:48:04.815 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.149.253:38083(127.4.149.253:38083)] Successfully connected to peer
23:48:04.818 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:04.825 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x077c716e, L:/127.0.0.1:59422 - R:/127.4.149.253:38083] using SASL/PLAIN
23:48:04.826 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.253
23:48:04.832 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] Successfully connected to peer
23:48:04.834 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=123), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [104ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: OK, deferred=null) after lookup
23:48:04.839 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.846 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.847 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.848 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@eea6f22
23:48:04.849 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:04.850 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a780cbaae38e2f8480d110408d6f2c48585f77b9967f733f851e764b2446118b'}]
23:48:04.850 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:48:04.850 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:48:04.852 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.852 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.856 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdc290d1e, L:/127.0.0.1:53776 - R:/127.4.149.254:41393] using SASL/PLAIN
23:48:04.857 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:04.869 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xeea8e26c, L:/127.0.0.1:46762 - R:/127.4.149.252:44265] using SASL/PLAIN
23:48:04.870 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:04.870 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8d32e7eeb06a99d3cbecbb8d5999ecea0e82ace57e776c0b50f3c4c30e30d9ca'}]
23:48:04.871 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.872 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:04.874 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:04.875 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:04.879 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd05f7b20, L:/127.0.0.1:59428 - R:/127.4.149.253:38083] using SASL/PLAIN
23:48:04.880 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:04.881 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299997, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:04.881 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.885 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x070445f2, L:/127.0.0.1:57820 - R:/127.4.149.194:34185] using TOKEN/null
23:48:04.887 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:04.889 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.149.252:44265(127.4.149.252:44265)] Successfully connected to peer
23:48:04.891 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:04.892 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.252
23:48:04.898 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.149.253:38083(127.4.149.253:38083)] Successfully connected to peer
23:48:04.900 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:04.901 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.149.253
23:48:04.912 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.916 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf789cfd8, L:/127.0.0.1:46774 - R:/127.4.149.252:44265] using SASL/PLAIN
23:48:04.920 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.920 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:04.922 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.924 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:04.925 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.926 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:04.928 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc6758a83, L:/127.0.0.1:59444 - R:/127.4.149.253:38083] using SASL/PLAIN
23:48:04.929 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.931 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:04.939 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:04.941 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:04.941 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=215), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [109ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: OK, deferred=null) after lookup
23:48:04.943 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.149.254:41393(127.4.149.254:41393)] Successfully connected to peer
23:48:04.945 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.947 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.948 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4df8a169
23:48:04.949 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:48:04.950 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:48:04.953 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:04.953 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=235), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [180ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: OK, [184ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: OK, deferred=null) after lookup
23:48:04.956 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.957 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.149.254:41393(127.4.149.254:41393)] Successfully connected to peer
23:48:04.959 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:04.959 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a25db6c
23:48:04.960 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:04.961 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:04.965 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:48:04.965 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:48:04.969 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:04.979 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.984 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xefbfb21c, L:/127.0.0.1:35386 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:04.986 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.992 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.992 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:04.996 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:04.997 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:04.998 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.004 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.004 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.008 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.009 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.015 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.015 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:05.015 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a1e009be8027aeb1cce48ba4b3ee1c850c80ebd1f6d697a8f0fb694706e5b1e6'}]
23:48:05.018 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:05.018 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.019 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x12230457, L:/127.0.0.1:35398 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:05.021 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:05.022 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9ba9fb2393f127be21b90fb970ef24b011a19cf4cabe6a632028fcb86dafe806'}]
23:48:05.024 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:05.026 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:05.028 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:05.030 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:05.031 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3c4b0592, L:/127.0.0.1:53780 - R:/127.4.149.254:41393] using TOKEN/null
23:48:05.033 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5ae74af9, L:/127.0.0.1:53794 - R:/127.4.149.254:41393] using TOKEN/null
23:48:05.034 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:05.046 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305085274198016001) for scanner KuduScanner(table=replication_test_table, tablet=adcf4679f475414d88d97e4f0da4cdfd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.047 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [8d32e7eeb06a99d3cbecbb8d5999ecea0e82ace57e776c0b50f3c4c30e30d9ca]
23:48:05.047 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:05.050 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8d32e7eeb06a99d3cbecbb8d5999ecea0e82ace57e776c0b50f3c4c30e30d9ca]
23:48:05.052 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8d32e7eeb06a99d3cbecbb8d5999ecea0e82ace57e776c0b50f3c4c30e30d9ca finished by subtask 2; deferring removal (restored in pending)
23:48:05.052 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:05.052 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:05.052 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:05.053 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:05.054 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 94bc29aa63a540e49702b0e676cc0908 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:05.054 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.054 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:05.054 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.055 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.055 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=94bc29aa63a540e49702b0e676cc0908@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.055 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1f02decd5ebab6dd3e55aee60957308344eaab07c20bc851fc1ac6e3bf236d41'}]
23:48:05.058 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}]
23:48:05.061 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:05.064 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7305085274198016001) for scanner KuduScanner(table=replication_test_table, tablet=ad1717b59e6a4882bde027a3330b8294, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.065 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [a780cbaae38e2f8480d110408d6f2c48585f77b9967f733f851e764b2446118b]
23:48:05.066 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:05.078 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:05.078 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.079 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.079 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bad2d40e1ed6408993080941c43ccc74 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:05.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 94bc29aa63a540e49702b0e676cc0908 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:05.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.080 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=bad2d40e1ed6408993080941c43ccc74@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=94bc29aa63a540e49702b0e676cc0908@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.082 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:05.084 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet bad2d40e1ed6408993080941c43ccc74 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:05.084 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 94bc29aa63a540e49702b0e676cc0908 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:05.084 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.084 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.085 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.085 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.085 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.085 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=bad2d40e1ed6408993080941c43ccc74@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=94bc29aa63a540e49702b0e676cc0908@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.086 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a780cbaae38e2f8480d110408d6f2c48585f77b9967f733f851e764b2446118b]
23:48:05.087 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a780cbaae38e2f8480d110408d6f2c48585f77b9967f733f851e764b2446118b finished by subtask 3; deferring removal (restored in pending)
23:48:05.087 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:05.087 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:05.087 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:05.088 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:05.091 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.091 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.093 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468085091 for job 6446e0085b210020482ce7a622d23630.
23:48:05.093 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:05.101 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5eae3eec, flushNotification=Deferred@1637903193(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:05.102 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] connecting to peer
23:48:05.107 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:05.111 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=130, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@769244ce, flushNotification=Deferred@690169670(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:05.113 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] connecting to peer
23:48:05.113 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.114 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.120 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.132 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:05.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:05.133 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:05.133 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:05.139 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:05.140 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:05.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:05.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:05.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:05.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:05.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:05.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:05.140 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:05.143 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:05.143 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:05.143 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:05.143 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:05.158 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] Successfully connected to peer
23:48:05.167 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468085167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:05.174 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:05.181 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:48:05.183 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.183 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.173 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] Successfully connected to peer
23:48:05.187 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
23:48:05.180 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:05.191 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:05.191 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.191 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.197 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.198 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.200 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.205 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaeb02e23, L:/127.0.0.1:35406 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:05.210 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.210 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.218 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.238 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.243 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7305085274198016001) for scanner KuduScanner(table=replication_test_table, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.244 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [a1e009be8027aeb1cce48ba4b3ee1c850c80ebd1f6d697a8f0fb694706e5b1e6]
23:48:05.245 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:05.249 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.252 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x1223953b, L:/127.0.0.1:37754 - R:/127.4.149.193:36799] using TOKEN/null
23:48:05.251 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a1e009be8027aeb1cce48ba4b3ee1c850c80ebd1f6d697a8f0fb694706e5b1e6]
23:48:05.256 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:05.256 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:05.256 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a1e009be8027aeb1cce48ba4b3ee1c850c80ebd1f6d697a8f0fb694706e5b1e6 finished by subtask 0; deferring removal (restored in pending)
23:48:05.256 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:05.257 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.257 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.257 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.257 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:05.258 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.258 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.258 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.259 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.259 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.259 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.259 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.260 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.260 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.262 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8a6c1582, L:/127.0.0.1:37760 - R:/127.4.149.193:36799] using TOKEN/null
23:48:05.278 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.278 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.289 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.289 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.293 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:05.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:05.293 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:05.294 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:05.303 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.303 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.300 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:05.314 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.315 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.319 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.320 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:05.344 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.352 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:05.352 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:05.352 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:05.353 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:05.356 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:05.363 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x67511c54, L:/127.0.0.1:35422 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:05.381 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.382 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.391 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.405 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.413 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.413 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.426 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:05.426 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305085274198016001) for scanner KuduScanner(table=replication_test_table, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.427 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [9ba9fb2393f127be21b90fb970ef24b011a19cf4cabe6a632028fcb86dafe806]
23:48:05.428 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:05.435 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9ba9fb2393f127be21b90fb970ef24b011a19cf4cabe6a632028fcb86dafe806]
23:48:05.435 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:05.435 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:05.436 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:05.436 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:05.437 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9ba9fb2393f127be21b90fb970ef24b011a19cf4cabe6a632028fcb86dafe806 finished by subtask 1; deferring removal (restored in pending)
23:48:05.439 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.439 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.440 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.440 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.441 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.447 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.447 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.447 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.448 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.449 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.449 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.449 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.450 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.456 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:05.456 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:05.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:05.457 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:05.459 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.467 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 6446e0085b210020482ce7a622d23630 (4449 bytes, checkpointDuration=375 ms, finalizationTime=1 ms).
23:48:05.470 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:48:05.470 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split a1e009be8027aeb1cce48ba4b3ee1c850c80ebd1f6d697a8f0fb694706e5b1e6 from pending
23:48:05.473 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 9ba9fb2393f127be21b90fb970ef24b011a19cf4cabe6a632028fcb86dafe806 from pending
23:48:05.474 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 8d32e7eeb06a99d3cbecbb8d5999ecea0e82ace57e776c0b50f3c4c30e30d9ca from pending
23:48:05.474 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split a780cbaae38e2f8480d110408d6f2c48585f77b9967f733f851e764b2446118b from pending
23:48:05.474 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 4 finished splits from enumerator state
23:48:05.493 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.506 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x065c638f, L:/127.0.0.1:35434 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:05.525 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.525 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.540 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.540 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.546 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.546 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.552 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.552 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.562 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085274198016001) for scanner KuduScanner(table=replication_test_table, tablet=d157534ed83945df9c51a974fa62d3dd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.563 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [1f02decd5ebab6dd3e55aee60957308344eaab07c20bc851fc1ac6e3bf236d41]
23:48:05.563 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1f02decd5ebab6dd3e55aee60957308344eaab07c20bc851fc1ac6e3bf236d41]
23:48:05.564 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:05.564 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:05.565 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1f02decd5ebab6dd3e55aee60957308344eaab07c20bc851fc1ac6e3bf236d41 finished by subtask 2; deferring removal (restored in pending)
23:48:05.565 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:05.566 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:05.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468085591 for job 6446e0085b210020482ce7a622d23630.
23:48:05.595 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7b8ea5d0, flushNotification=Deferred@1497901508(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:05.596 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] connecting to peer
23:48:05.596 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=195, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@44109087, flushNotification=Deferred@1751868304(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:05.597 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] connecting to peer
23:48:05.619 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.619 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.626 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.626 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.632 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.632 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.644 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.658 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:05.658 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:05.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:05.658 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:05.667 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468085667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:05.681 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] Successfully connected to peer
23:48:05.685 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
23:48:05.688 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
23:48:05.702 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.703 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.710 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.710 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.717 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] Successfully connected to peer
23:48:05.729 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.729 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.729 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.733 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x393571e9, L:/127.0.0.1:37776 - R:/127.4.149.193:36799] using TOKEN/null
23:48:05.734 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.734 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.741 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.752 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:05.758 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x69a25258, L:/127.0.0.1:57824 - R:/127.4.149.194:34185] using TOKEN/null
23:48:05.809 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.809 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 6446e0085b210020482ce7a622d23630 (1661 bytes, checkpointDuration=218 ms, finalizationTime=0 ms).
23:48:05.809 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.811 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:48:05.812 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 1f02decd5ebab6dd3e55aee60957308344eaab07c20bc851fc1ac6e3bf236d41 from pending
23:48:05.812 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 1 finished splits from enumerator state
23:48:05.820 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.820 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.833 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.833 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:05.842 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.842 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:05.849 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.852 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:05.855 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:05.862 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:05.865 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:05.870 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:05.870 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:05.870 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.870 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.870 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.872 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299998, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299998, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299998, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299998}]
23:48:05.877 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bad2d40e1ed6408993080941c43ccc74 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:05.877 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 94bc29aa63a540e49702b0e676cc0908 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:05.877 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.877 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.877 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.878 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=bad2d40e1ed6408993080941c43ccc74@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=94bc29aa63a540e49702b0e676cc0908@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.879 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:05.880 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:05.880 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:05.881 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:05.881 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:05.881 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:05.882 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:05.881 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:05.882 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:05.882 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:05.882 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:05.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:05.883 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:05.884 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:05.888 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 44e0d555aac84dc2a3a2eddc2e75501f
23:48:05.891 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:05.891 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:05.891 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:05.891 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:05.892 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:05.892 [DEBUG - main] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:05.892 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [3ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=null)) after lookup
23:48:05.902 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ad1717b59e6a4882bde027a3330b8294, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.903 [DEBUG - main] (AsyncKuduScanner.java:822) Done scanning tablet ad1717b59e6a4882bde027a3330b8294 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:05.945 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=adcf4679f475414d88d97e4f0da4cdfd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.946 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet adcf4679f475414d88d97e4f0da4cdfd for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:05.986 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:05.986 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:06.005 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.005 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:06.017 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d157534ed83945df9c51a974fa62d3dd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.021 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bad2d40e1ed6408993080941c43ccc74 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:06.021 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 94bc29aa63a540e49702b0e676cc0908 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:06.022 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3546ff67dddb42bb9d7ff65a7e827484 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:06.022 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d61998f73f2a49bdb444851539491fcb for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:06.022 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a89203da901b4a1ab871fa5bd4b24010 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:06.022 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=bad2d40e1ed6408993080941c43ccc74@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=94bc29aa63a540e49702b0e676cc0908@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=3546ff67dddb42bb9d7ff65a7e827484@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)[L],64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=d61998f73f2a49bdb444851539491fcb@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=a89203da901b4a1ab871fa5bd4b24010@[086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185),64c2cb13f0c2407b9ebfcb431ccf83a9(127.4.149.195:44019),ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:06.022 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.149.252:44265, [3ms] Sub RPC GetTableLocations: received response from server master-127.4.149.252:44265: OK, deferred=null)) after lookup
23:48:06.032 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.033 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:06.043 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.044 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:06.072 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.072 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:06.082 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.082 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:06.089 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468086091 for job 6446e0085b210020482ce7a622d23630.
23:48:06.100 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ad1717b59e6a4882bde027a3330b8294, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.100 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ad1717b59e6a4882bde027a3330b8294 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:06.113 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 6446e0085b210020482ce7a622d23630 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
23:48:06.115 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:48:06.120 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=adcf4679f475414d88d97e4f0da4cdfd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.120 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet adcf4679f475414d88d97e4f0da4cdfd for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:06.133 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.134 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:06.154 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.154 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:06.162 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d157534ed83945df9c51a974fa62d3dd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468086167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:06.174 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bad2d40e1ed6408993080941c43ccc74, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.174 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bad2d40e1ed6408993080941c43ccc74 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
23:48:06.183 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:48:06.183 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=94bc29aa63a540e49702b0e676cc0908, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.184 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 94bc29aa63a540e49702b0e676cc0908 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
23:48:06.185 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
23:48:06.195 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3546ff67dddb42bb9d7ff65a7e827484, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.196 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3546ff67dddb42bb9d7ff65a7e827484 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
23:48:06.215 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d61998f73f2a49bdb444851539491fcb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.216 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet d61998f73f2a49bdb444851539491fcb for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
23:48:06.223 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a89203da901b4a1ab871fa5bd4b24010, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.223 [DEBUG - main] (Connection.java:575) [peer master-127.4.149.252:44265(127.4.149.252:44265)] disconnecting while in state READY
23:48:06.223 [DEBUG - main] (Connection.java:575) [peer master-127.4.149.253:38083(127.4.149.253:38083)] disconnecting while in state READY
23:48:06.224 [DEBUG - main] (Connection.java:575) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] disconnecting while in state READY
23:48:06.224 [DEBUG - main] (Connection.java:575) [peer master-127.4.149.254:41393(127.4.149.254:41393)] disconnecting while in state READY
23:48:06.224 [DEBUG - main] (Connection.java:575) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] disconnecting while in state READY
23:48:06.225 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.149.254:41393(127.4.149.254:41393)] handling channelInactive
23:48:06.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state READY due to: connection closed
23:48:06.225 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.149.253:38083(127.4.149.253:38083)] handling channelInactive
23:48:06.225 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state READY due to: connection closed
23:48:06.226 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.149.252:44265(127.4.149.252:44265)] handling channelInactive
23:48:06.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state READY due to: connection closed
23:48:06.227 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] handling channelInactive
23:48:06.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] cleaning up while in state READY due to: connection closed
23:48:06.228 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:06.230 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
23:48:06.230 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:06.231 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:48:06.231 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
23:48:06.232 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] handling channelInactive
23:48:06.233 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] cleaning up while in state READY due to: connection closed
23:48:06.233 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
23:48:06.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:06.232923  4695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4981
23:48:06.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:06.312748  5104 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:06.525 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:06.530 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:06.530 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:06.530 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:06.531 [DEBUG - kudu-nio-2] (NetUtil.java:139) Resolved '127.3.230.194' into [/127.3.230.194] in 1023036ns
23:48:06.532 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:06.532 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:06.533 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299998, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299998, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299998, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299998}]
23:48:06.537 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9096a5ffabe99dfd49da8fac6cb6abaf4f29477d5bd453c40e6285fe28225c65'}]
23:48:06.538 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='443369b30c839c0458116aa9cb257478af6889001baaea209d138fbef35ecd93'}]
23:48:06.539 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:06.539 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='972f35bc2a65cf0209d3ffa39f2d916f3268869cf7c37b841e446f6aaaab5efc'}]
23:48:06.540 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:06.540 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:06.541 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:06.541 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299996, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:06.542 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cc9de18e98430ba757f141c14454cf3a1a565d601e566fd14ecbe0961a2ae059'}]
23:48:06.543 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:06.544 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:06.546 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299996, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:06.546 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:06.547 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299996, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}]
23:48:06.547 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:06.548 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299996, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:06.568 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:06.573 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:06.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468086591 for job 6446e0085b210020482ce7a622d23630.
23:48:06.596 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:06.603 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:06.609 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:06.610 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
23:48:06.611 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:48:06.620 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:06.622 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:06.630 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:06.639 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:06.644 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:06.645 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:06.645 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:06.658 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1a1ff32b, L:/127.0.0.1:35438 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:06.661 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:06.665 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:06.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468086667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:06.686 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
23:48:06.688 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
23:48:06.718 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf0a7c61f, L:/127.0.0.1:35460 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:06.734 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:06.735 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:06.752 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x731db63f, L:/127.0.0.1:35446 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:06.757 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4abc8918, L:/127.0.0.1:35464 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:06.848 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085282385920001) for scanner KuduScanner(table=replication_test_table, tablet=adcf4679f475414d88d97e4f0da4cdfd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.849 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [443369b30c839c0458116aa9cb257478af6889001baaea209d138fbef35ecd93]
23:48:06.849 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [443369b30c839c0458116aa9cb257478af6889001baaea209d138fbef35ecd93]
23:48:06.850 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:06.850 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:06.850 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085282385920001) for scanner KuduScanner(table=replication_test_table, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.851 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [972f35bc2a65cf0209d3ffa39f2d916f3268869cf7c37b841e446f6aaaab5efc]
23:48:06.851 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [972f35bc2a65cf0209d3ffa39f2d916f3268869cf7c37b841e446f6aaaab5efc]
23:48:06.851 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:06.851 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:06.852 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 443369b30c839c0458116aa9cb257478af6889001baaea209d138fbef35ecd93 finished by subtask 0; deferring removal (restored in pending)
23:48:06.852 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 972f35bc2a65cf0209d3ffa39f2d916f3268869cf7c37b841e446f6aaaab5efc finished by subtask 1; deferring removal (restored in pending)
23:48:06.853 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='833e176dd1425cbc402dbb8b30a04175abdfde43da9aac8f8108136e94508709'}]
23:48:06.854 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:06.855 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:06.855 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:06.855 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:06.857 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085282385920001) for scanner KuduScanner(table=replication_test_table, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.858 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [cc9de18e98430ba757f141c14454cf3a1a565d601e566fd14ecbe0961a2ae059]
23:48:06.858 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cc9de18e98430ba757f141c14454cf3a1a565d601e566fd14ecbe0961a2ae059]
23:48:06.858 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:48:06.858 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:48:06.859 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:06.860 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:06.860 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:06.862 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cc9de18e98430ba757f141c14454cf3a1a565d601e566fd14ecbe0961a2ae059 finished by subtask 2; deferring removal (restored in pending)
23:48:06.867 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:06.868 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299996, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:06.874 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085282385920001) for scanner KuduScanner(table=replication_test_table, tablet=ad1717b59e6a4882bde027a3330b8294, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:06.874 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [9096a5ffabe99dfd49da8fac6cb6abaf4f29477d5bd453c40e6285fe28225c65]
23:48:06.875 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9096a5ffabe99dfd49da8fac6cb6abaf4f29477d5bd453c40e6285fe28225c65]
23:48:06.875 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:06.875 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:06.876 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9096a5ffabe99dfd49da8fac6cb6abaf4f29477d5bd453c40e6285fe28225c65 finished by subtask 3; deferring removal (restored in pending)
23:48:06.877 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:06.878 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:06.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:06.899662  4695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4981
23:48:06.949 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:06.961 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] handling channelInactive
23:48:06.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] cleaning up while in state READY due to: connection closed
23:48:06.961 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] handling channelInactive
23:48:06.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] cleaning up while in state READY due to: connection closed
23:48:06.962 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] handling channelInactive
23:48:06.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] cleaning up while in state READY due to: connection closed
23:48:06.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:06.962615  5274 connection.cc:573] server connection from 127.4.149.193:38007 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:06.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:06.965324  4695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 5119
23:48:06.990 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:06.990 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:06.991 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:06.991 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:07.009 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:07.009 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:07.010 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:07.010 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.011257  5243 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:07.012 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:07.021 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:07.034 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:07.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:07.035 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:07.049 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
23:48:07.061 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:07.067 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xee4ec109, L:/127.0.0.1:35474 - R:/127.3.230.193:42511] using SASL/PLAIN
23:48:07.078 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085282385920001) for scanner KuduScanner(table=replication_test_table, tablet=d157534ed83945df9c51a974fa62d3dd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:07.078 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [833e176dd1425cbc402dbb8b30a04175abdfde43da9aac8f8108136e94508709]
23:48:07.078 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [833e176dd1425cbc402dbb8b30a04175abdfde43da9aac8f8108136e94508709]
23:48:07.079 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:48:07.080 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 833e176dd1425cbc402dbb8b30a04175abdfde43da9aac8f8108136e94508709 finished by subtask 0; deferring removal (restored in pending)
23:48:07.080 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:48:07.081 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:07.083 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:07.095 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468087091 for job 6446e0085b210020482ce7a622d23630.
23:48:07.108 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:48:07.111 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:48:07.111 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 9096a5ffabe99dfd49da8fac6cb6abaf4f29477d5bd453c40e6285fe28225c65 from pending
23:48:07.111 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 443369b30c839c0458116aa9cb257478af6889001baaea209d138fbef35ecd93 from pending
23:48:07.111 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 972f35bc2a65cf0209d3ffa39f2d916f3268869cf7c37b841e446f6aaaab5efc from pending
23:48:07.111 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split cc9de18e98430ba757f141c14454cf3a1a565d601e566fd14ecbe0961a2ae059 from pending
23:48:07.111 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 833e176dd1425cbc402dbb8b30a04175abdfde43da9aac8f8108136e94508709 from pending
23:48:07.111 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 5 finished splits from enumerator state
23:48:07.114 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:07.115 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:07.115 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:07.115 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:07.147 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:07.147 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:07.147 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:07.148 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:07.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468087167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:07.184 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:48:07.186 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
23:48:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.348625  4695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 5119
23:48:07.387 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] handling channelInactive
23:48:07.387 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] cleaning up while in state READY due to: connection closed
23:48:07.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.390242  4695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 5257
23:48:07.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.416080  5381 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:07.594 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468087591 for job 6446e0085b210020482ce7a622d23630.
23:48:07.606 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 6446e0085b210020482ce7a622d23630 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:07.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:48:07.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.629624  4695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 5257
23:48:07.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.658135  4695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4706
23:48:07.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.659838  4768 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:07.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468087667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:07.684 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:07.685 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
23:48:07.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.864588  4695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4706
23:48:07.894 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.149.254:41393(127.4.149.254:41393)] handling channelInactive
23:48:07.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state READY due to: connection closed
23:48:07.894 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.149.254:41393(127.4.149.254:41393)] handling channelInactive
23:48:07.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state READY due to: connection closed
23:48:07.897 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.149.254:41393(127.4.149.254:41393)] handling channelInactive
23:48:07.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state READY due to: connection closed
23:48:07.898 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.149.254:41393(127.4.149.254:41393)] handling channelInactive
23:48:07.898 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state READY due to: connection closed
23:48:07.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.899091  4695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4775
23:48:07.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:07.900516  4839 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:08.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.023950  4695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4775
23:48:08.057 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.149.253:38083(127.4.149.253:38083)] handling channelInactive
23:48:08.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state READY due to: connection closed
23:48:08.057 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.149.253:38083(127.4.149.253:38083)] handling channelInactive
23:48:08.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state READY due to: connection closed
23:48:08.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:08.057118  4866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.149.253:38083 (error 108)
23:48:08.058 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.149.253:38083(127.4.149.253:38083)] handling channelInactive
23:48:08.058 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state READY due to: connection closed
23:48:08.059 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.149.253:38083(127.4.149.253:38083)] handling channelInactive
23:48:08.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state READY due to: connection closed
23:48:08.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.061251  4695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4846
23:48:08.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.062668  4912 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:08.091 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468088091 for job 6446e0085b210020482ce7a622d23630.
23:48:08.106 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 6446e0085b210020482ce7a622d23630 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:08.107 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:48:08.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468088167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:08.184 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
23:48:08.186 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
23:48:08.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:08.245626  4866 consensus_peers.cc:597] T 00000000000000000000000000000000 P e94e7039c04b4507b42c4905b94bdfb0 -> Peer 25281fa178114dc8bc4d1576b68ea2c3 (127.4.149.253:38083): Couldn't send request to peer 25281fa178114dc8bc4d1576b68ea2c3. Status: Network error: Client connection negotiation failed: client connection to 127.4.149.253:38083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:48:08.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:08.245855  4866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.149.253:38083, user_credentials={real_user=slave}} blocked reactor thread for 182504us
23:48:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.247396  4695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4846
23:48:08.287 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.149.252:44265(127.4.149.252:44265)] handling channelInactive
23:48:08.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state READY due to: connection closed
23:48:08.288 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.149.252:44265(127.4.149.252:44265)] handling channelInactive
23:48:08.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state READY due to: connection closed
23:48:08.288 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.149.252:44265(127.4.149.252:44265)] handling channelInactive
23:48:08.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state READY due to: connection closed
23:48:08.289 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.149.252:44265(127.4.149.252:44265)] handling channelInactive
23:48:08.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state READY due to: connection closed
23:48:08.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:08Z chronyd exiting
23:48:08.473 [DEBUG - main] (Connection.java:575) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] disconnecting while in state READY
23:48:08.473 [DEBUG - main] (Connection.java:575) [peer master-127.3.230.254:44025(127.3.230.254:44025)] disconnecting while in state READY
23:48:08.473 [DEBUG - main] (Connection.java:575) [peer master-127.3.230.252:37691(127.3.230.252:37691)] disconnecting while in state READY
23:48:08.473 [DEBUG - main] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state READY
23:48:08.473 [DEBUG - main] (Connection.java:575) [peer master-127.3.230.253:41003(127.3.230.253:41003)] disconnecting while in state READY
23:48:08.473 [DEBUG - main] (Connection.java:575) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] disconnecting while in state READY
23:48:08.474 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] handling channelInactive
23:48:08.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state READY due to: connection closed
23:48:08.475 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:08.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state READY due to: connection closed
23:48:08.476 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:08.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:08.477 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:08.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state READY due to: connection closed
23:48:08.477 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:08.477 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:08.478 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:08.482 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:08.482 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
23:48:08.483 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
23:48:08.483 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:08.483 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
23:48:08.484 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] handling channelInactive
23:48:08.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state READY due to: connection closed
23:48:08.484 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
23:48:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.485476  3995 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4278
23:48:08.524 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table fec8e6d6ddec481ba78f51dba8b87df3
23:48:08.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.524770  4402 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:08.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:08.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:08.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:08.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:08.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:08.528 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:08.535 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f64acf0b9a7ea20a8967f9ffc77cf540df3f25ebb95117d10115d6693867f47f'}]
23:48:08.537 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:08.538 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:08.538 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cc1ec440c91a808f26b6b79d70f14c3f945a4b4800d24d0aec22ad14bb5d5939'}]
23:48:08.539 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299995, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:08.540 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:08.541 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:48:08.541 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:08.542 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299995, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:08.544 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='89720f8035fdc8f1890a86c4a8fef2d1629315ff54fd98a8855cab05af22d730'}]
23:48:08.545 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:08.546 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:08.546 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:08.546 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6b3f0bf8ea87eddb8fa9a26b652aa44162799538733cd894173e5e681b665f7c'}]
23:48:08.547 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299995, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}]
23:48:08.548 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:08.548 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:48:08.549 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:08.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299995, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}]
23:48:08.553 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:08.557 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:08.558 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:08.561 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:08.562 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:08.564 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] Successfully connected to peer
23:48:08.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468088591 for job 6446e0085b210020482ce7a622d23630.
23:48:08.605 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:48:08.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
23:48:08.667 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468088667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:08.677 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:08.679 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
23:48:08.781 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:08.781 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:08.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.790745  3995 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4278
23:48:08.791 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.193
23:48:08.796 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:08.831 [ERROR - kudu-nio-0] (Connection.java:452) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:08.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state NEGOTIATING due to: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511]
23:48:08.831 [ERROR - kudu-nio-0] (Connection.java:452) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:08.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state NEGOTIATING due to: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511]
23:48:08.831 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet adcf4679f475414d88d97e4f0da4cdfd: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511]
23:48:08.831 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet ad1717b59e6a4882bde027a3330b8294: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511]
23:48:08.832 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:08.831 [ERROR - kudu-nio-0] (Connection.java:452) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:08.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.831984  3995 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4417
23:48:08.832 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state NEGOTIATING due to: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511]
23:48:08.833 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511]
23:48:08.833 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:08.833 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:08.832 [ERROR - kudu-nio-0] (Connection.java:452) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:08.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state NEGOTIATING due to: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511]
23:48:08.833 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511]
23:48:08.833 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:08.834 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] handling channelInactive
23:48:08.835 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] Successfully connected to peer
23:48:08.837 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:08.839 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:08.841 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.194
23:48:08.842 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:08.843 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] Successfully connected to peer
23:48:08.845 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] Successfully connected to peer
23:48:08.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.845327  4541 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:08.847 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.194
23:48:08.853 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] Successfully connected to peer
23:48:09.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:08.999815  3995 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4417
23:48:09.002 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.028 [ERROR - kudu-nio-1] (Connection.java:452) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state NEGOTIATING due to: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625]
23:48:09.028 [ERROR - kudu-nio-1] (Connection.java:452) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state NEGOTIATING due to: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625]
23:48:09.028 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625]
23:48:09.028 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet ad1717b59e6a4882bde027a3330b8294: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625]
23:48:09.029 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] handling channelInactive
23:48:09.028 [ERROR - kudu-nio-1] (Connection.java:452) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.029 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] handling channelInactive
23:48:09.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state NEGOTIATING due to: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625]
23:48:09.029 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] handling channelInactive
23:48:09.029 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625]
23:48:09.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state NEGOTIATING due to: connection closed
23:48:09.029 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet adcf4679f475414d88d97e4f0da4cdfd: connection closed
23:48:09.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.030009  3995 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4556
23:48:09.030 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] handling channelInactive
23:48:09.034 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.035 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] Successfully connected to peer
23:48:09.037 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.038 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.195
23:48:09.039 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.039351  4680 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:09.039 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] Successfully connected to peer
23:48:09.041 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.195
23:48:09.042 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.045 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] Successfully connected to peer
23:48:09.045 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] Successfully connected to peer
23:48:09.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468089091 for job 6446e0085b210020482ce7a622d23630.
23:48:09.102 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:09.104 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
23:48:09.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468089167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:09.179 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:09.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
23:48:09.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.204236  3995 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4556
23:48:09.230 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] handling channelInactive
23:48:09.230 [ERROR - kudu-nio-2] (Connection.java:452) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state NEGOTIATING due to: connection closed
23:48:09.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state NEGOTIATING due to: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473]
23:48:09.230 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] handling channelInactive
23:48:09.230 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet adcf4679f475414d88d97e4f0da4cdfd: connection closed
23:48:09.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.230657  3995 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4007
23:48:09.230 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473]
23:48:09.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state NEGOTIATING due to: connection closed
23:48:09.231 [ERROR - kudu-nio-2] (Connection.java:452) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.231 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: connection closed
23:48:09.231 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state NEGOTIATING due to: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473]
23:48:09.231 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] handling channelInactive
23:48:09.231 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet ad1717b59e6a4882bde027a3330b8294: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473]
23:48:09.231 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] handling channelInactive
23:48:09.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.232345  4069 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:09.233 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:09.235 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:09.235 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:09.237 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:09.238 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:09.242 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:09.242 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:09.244 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:09.245 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:09.252 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:09.254 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:09.258 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:09.258 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:09.259 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:09.261 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:09.261 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:09.262 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:09.264 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:09.264 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:09.267 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.268 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:09.272 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:09.275 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.279 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x65b6f6de, L:/127.0.0.1:54644 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:09.282 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:09.287 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:09.288 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:09.291 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.295 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x91295c05, L:/127.0.0.1:49400 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:09.296 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x7726e7c6, L:/127.0.0.1:54648 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:09.297 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:09.299 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:09.299 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29310, elapsed=66), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:09.301 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:09.305 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.3.230.254:44025(127.3.230.254:44025)] Successfully connected to peer
23:48:09.306 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.3.230.253:41003(127.3.230.253:41003)] Successfully connected to peer
23:48:09.305 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:09.309 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:09.309 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.309 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.309 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.309 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=adcf4679f475414d88d97e4f0da4cdfd, attempt=4, KuduRpc(method=Scan, tablet=adcf4679f475414d88d97e4f0da4cdfd, attempt=4, TimeoutTracker(timeout=30000, elapsed=767), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [278ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511], [278ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [476ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: connection closed, [476ms] delaying RPC due to: Network error: connection closed, [481ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [677ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: connection closed, [677ms] delaying RPC due to: Network error: connection closed, [680ms] refreshing cache from master, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [728ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [747ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [752ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@1974416154(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0))) after lookup
23:48:09.310 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.312 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.314 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:09.318 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.253
23:48:09.332 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x3a4f67be, L:/127.0.0.1:49416 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:09.336 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.3.230.252:37691(127.3.230.252:37691)] Successfully connected to peer
23:48:09.339 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.252
23:48:09.339 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:09.340 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29299, elapsed=97), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [92ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:09.339 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.344 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.344 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x3cd5a8d6, L:/127.0.0.1:54654 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:09.345 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:09.345 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:09.345 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:09.345 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.345 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.346 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.346 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=ad1717b59e6a4882bde027a3330b8294, attempt=4, KuduRpc(method=Scan, tablet=ad1717b59e6a4882bde027a3330b8294, attempt=4, TimeoutTracker(timeout=30000, elapsed=806), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [290ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511], [291ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511], [301ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [487ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625], [487ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625], [501ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [690ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473], [690ms] delaying RPC due to: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473], [701ms] refreshing cache from master, [701ms] Sub RPC GetTableLocations: refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [793ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [799ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [804ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@627825512(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup
23:48:09.347 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.351 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.353 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.353 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet adcf4679f475414d88d97e4f0da4cdfd: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.353 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.352 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x38e18749, L:/127.0.0.1:49428 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:09.356 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:09.356 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:09.357 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29310, elapsed=119), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [119ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:09.358 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xef6fe33e, L:/127.0.0.1:54664 - R:/127.3.230.253:41003] using SASL/PLAIN
23:48:09.360 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:09.360 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.360 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.361 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.361 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, attempt=4, KuduRpc(method=Scan, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, attempt=4, TimeoutTracker(timeout=30000, elapsed=813), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [276ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511], [276ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [472ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625], [472ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625], [480ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [674ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: connection closed, [674ms] delaying RPC due to: Network error: connection closed, [680ms] refreshing cache from master, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [767ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [799ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [800ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [803ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@107630981(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0))) after lookup
23:48:09.363 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xe3daad3c, L:/127.0.0.1:49440 - R:/127.3.230.252:37691] using SASL/PLAIN
23:48:09.364 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.366 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:09.366 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29292, elapsed=107), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [107ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, deferred=null) after lookup
23:48:09.368 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.368 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.368 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.369 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, attempt=4, KuduRpc(method=Scan, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, attempt=4, TimeoutTracker(timeout=30000, elapsed=818), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [275ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511], [275ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [470ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625], [470ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625], [481ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [672ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473], [673ms] delaying RPC due to: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473], [700ms] refreshing cache from master, [700ms] Sub RPC GetTableLocations: refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [729ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [730ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [807ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [808ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [810ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@2075948387(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0))) after lookup
23:48:09.369 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.372 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.372 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.372 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet ad1717b59e6a4882bde027a3330b8294: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.376 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.376 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.376 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.379 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.379 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.380 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.393 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.395 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.395 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.396 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet adcf4679f475414d88d97e4f0da4cdfd: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.402 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.404 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet ad1717b59e6a4882bde027a3330b8294: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.414 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.415 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet adcf4679f475414d88d97e4f0da4cdfd: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.417 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.418 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.420 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.230.254
23:48:09.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.420010  3995 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4007
23:48:09.421 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.421 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.421 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.423 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.437 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.438 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.438 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.438 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.439 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.440 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.447 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0x6880c67b, L:/127.0.0.1:48920 - R:/127.3.230.254:44025]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.447 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:09.447 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state NEGOTIATING due to: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0x6880c67b, L:/127.0.0.1:48920 - R:/127.3.230.254:44025]
23:48:09.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state READY due to: connection closed
23:48:09.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0x6880c67b, L:/127.0.0.1:48920 - R:/127.3.230.254:44025]
23:48:09.447 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:09.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.447352  3995 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4076
23:48:09.447 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xde4d7564, L:/127.0.0.1:48894 - R:/127.3.230.254:44025]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.448 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state NEGOTIATING due to: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xde4d7564, L:/127.0.0.1:48894 - R:/127.3.230.254:44025]
23:48:09.448 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xc01f4dd5, L:/127.0.0.1:48904 - R:/127.3.230.254:44025]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.448 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state NEGOTIATING due to: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xc01f4dd5, L:/127.0.0.1:48904 - R:/127.3.230.254:44025]
23:48:09.448 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xde4d7564, L:/127.0.0.1:48894 - R:/127.3.230.254:44025]
23:48:09.448 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xc01f4dd5, L:/127.0.0.1:48904 - R:/127.3.230.254:44025]
23:48:09.448 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:09.448 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:09.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.449168  4141 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:09.449 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xee684c47, L:/127.0.0.1:48882 - R:/127.3.230.254:44025]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:09.450 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state NEGOTIATING due to: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xee684c47, L:/127.0.0.1:48882 - R:/127.3.230.254:44025]
23:48:09.450 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: [peer master-127.3.230.254:44025(127.3.230.254:44025)] unexpected exception from downstream on [id: 0xee684c47, L:/127.0.0.1:48882 - R:/127.3.230.254:44025]
23:48:09.450 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.3.230.254:44025(127.3.230.254:44025)] handling channelInactive
23:48:09.456 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:09.456 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:09.456 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.456 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.456 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.457 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=adcf4679f475414d88d97e4f0da4cdfd, attempt=8, KuduRpc(method=Scan, tablet=adcf4679f475414d88d97e4f0da4cdfd, attempt=8, TimeoutTracker(timeout=30000, elapsed=914), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [278ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511], [278ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [476ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: connection closed, [476ms] delaying RPC due to: Network error: connection closed, [481ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [677ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: connection closed, [677ms] delaying RPC due to: Network error: connection closed, [680ms] refreshing cache from master, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [728ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [747ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [752ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [757ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [800ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [800ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [840ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [843ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [843ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [860ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [862ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [862ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [900ms] refreshing cache from master, [900ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [902ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@1974416154(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0 -> (continuation of Deferred@2105117752 after retry RPC@1821185052), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0 -> (continuation of Deferred@2105117752 after retry RPC@1821185052)))) after lookup
23:48:09.457 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.459 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet adcf4679f475414d88d97e4f0da4cdfd: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.461 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.462 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.463 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet ad1717b59e6a4882bde027a3330b8294: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.502 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.502 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.502 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.502 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, attempt=8, KuduRpc(method=Scan, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, attempt=8, TimeoutTracker(timeout=30000, elapsed=952), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [275ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511], [275ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [470ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625], [470ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625], [481ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [672ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473], [673ms] delaying RPC due to: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473], [700ms] refreshing cache from master, [700ms] Sub RPC GetTableLocations: refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [729ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [730ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [807ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [808ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [810ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [811ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [822ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [822ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [860ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [865ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [865ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [881ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [882ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [882ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [940ms] refreshing cache from master, [941ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [943ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@2075948387(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0 -> (continuation of Deferred@2075976504 after retry RPC@1705043109), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0 -> (continuation of Deferred@2075976504 after retry RPC@1705043109)))) after lookup
23:48:09.503 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.504 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.504 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.504 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.514 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.515 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet adcf4679f475414d88d97e4f0da4cdfd: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.520 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:09.520 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.520 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.520 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.521 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, attempt=8, KuduRpc(method=Scan, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, attempt=8, TimeoutTracker(timeout=30000, elapsed=973), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [276ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511], [276ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [472ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625], [472ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625], [480ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [674ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: connection closed, [674ms] delaying RPC due to: Network error: connection closed, [680ms] refreshing cache from master, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [767ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [799ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [800ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [803ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [806ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [819ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [819ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [860ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [864ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [864ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [880ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [881ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [881ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [960ms] refreshing cache from master, [960ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [963ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@107630981(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0 -> (continuation of Deferred@493772215 after retry RPC@1031630220), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0 -> (continuation of Deferred@493772215 after retry RPC@1031630220)))) after lookup
23:48:09.521 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.522 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.576969  3995 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4076
23:48:09.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468089591 for job 6446e0085b210020482ce7a622d23630.
23:48:09.605 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:09.605 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet ad1717b59e6a4882bde027a3330b8294 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
23:48:09.605 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:09.605 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet adcf4679f475414d88d97e4f0da4cdfd for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
23:48:09.605 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:09.605 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet f80c95fd8a794a1cb78e9c76d2f2a6cc for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
23:48:09.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:09.605 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 2abbce68bf9b4cc0b8028cafc59c9d59 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
23:48:09.605 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:09.605 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:09.605 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet d157534ed83945df9c51a974fa62d3dd for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
23:48:09.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:09.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:09.606 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.3.230.253:41003(127.3.230.253:41003)] handling channelInactive
23:48:09.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state READY due to: connection closed
23:48:09.606 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ad1717b59e6a4882bde027a3330b8294@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=adcf4679f475414d88d97e4f0da4cdfd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)[L],9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2abbce68bf9b4cc0b8028cafc59c9d59@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473),9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=d157534ed83945df9c51a974fa62d3dd@[8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)[L],9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625),9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
23:48:09.606 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=ad1717b59e6a4882bde027a3330b8294, attempt=8, KuduRpc(method=Scan, tablet=ad1717b59e6a4882bde027a3330b8294, attempt=8, TimeoutTracker(timeout=30000, elapsed=1065), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [290ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511], [291ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511], [301ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [487ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625], [487ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625], [501ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [690ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473], [690ms] delaying RPC due to: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473], [701ms] refreshing cache from master, [701ms] Sub RPC GetTableLocations: refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [793ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [799ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [804ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [805ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [831ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [831ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [861ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [863ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [863ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [920ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [922ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [922ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [1061ms] refreshing cache from master, [1061ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [1064ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, deferred=Deferred@627825512(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@1047500630 after retry RPC@1970880732), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@1047500630 after retry RPC@1970880732)))) after lookup
23:48:09.607 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:09.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.607173  3995 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 4148
23:48:09.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.608413  4213 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:09.610 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
23:48:09.611 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] connecting to peer
23:48:09.612 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.613 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.613 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511) for tablet ad1717b59e6a4882bde027a3330b8294: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511
23:48:09.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468089667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:09.679 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:09.679 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
23:48:09.714 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.715 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.715 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.715 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet adcf4679f475414d88d97e4f0da4cdfd: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.719 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.720 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:09.750470  3995 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 4148
23:48:09.758 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:09.759 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:09.759 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:09.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:09.760 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:09.759 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:09.760 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:09.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:09.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:09.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:09.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:09.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:09.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.761 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.761 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet 2abbce68bf9b4cc0b8028cafc59c9d59: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:09.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:09.762 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:09.778 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:09.778 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:09.778 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:09.778 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:09.779 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:09.779 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:09.779 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:09.779 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:09.780 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.3.230.252:37691(127.3.230.252:37691)] handling channelInactive
23:48:09.780 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state READY due to: connection closed
23:48:09.782 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.783 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet ad1717b59e6a4882bde027a3330b8294: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:09Z chronyd exiting
.23:48:09.959 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468089959
23:48:09.960 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468089960
23:48:09.964 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:48:09.967 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:48:09.968 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:48:09.968 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:48:09.968 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:48:09.968 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:48:09.972 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:48:09.997 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] connecting to peer
23:48:09.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.999 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:09.999 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625
23:48:10.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468090091 for job 6446e0085b210020482ce7a622d23630.
23:48:10.107 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:10.109 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
23:48:10.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468090167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:10.178 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:10.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
23:48:10.339 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.341 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location master-127.3.230.252:37691(127.3.230.252:37691) for tablet Kudu Master: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.356 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:10.357 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:48:10.358 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.359 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.359 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.360 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.360041  5901 mini_oidc.cc:150] Starting JWKS server
23:48:10.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.360 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.363112  5901 webserver.cc:534] Webserver started at http://127.0.0.1:37317/ using document root <none> and password file <none>
23:48:10.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.363351  5901 mini_oidc.cc:186] Starting OIDC Discovery server
23:48:10.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.363843  5901 webserver.cc:534] Webserver started at http://127.0.0.1:37655/ using document root <none> and password file <none>
23:48:10.378 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.379 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.379 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.379 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.379 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.380 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.380 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.380 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.380 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.380 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.380 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:48:10.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:10Z Disabled control of system clock
23:48:10.397 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:10.399 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:10.399 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:10.399 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.399 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet f80c95fd8a794a1cb78e9c76d2f2a6cc: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.399551  5901 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal
23:48:10.399 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/logs
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data/info.pb
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:10.400 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.400 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.400 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.400 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:10.400 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:10.400 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.126:36941
23:48:10.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.126
23:48:10.400 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37317/jwks.json with env {}
23:48:10.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.401 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.419 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.420 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.420 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.420 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.420 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.421 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.421 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.421 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.421 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.420 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.421 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.421 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.459 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.460 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.460 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.460 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.460 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.461 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.461 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.461 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.462 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.499 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.500 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.500 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.500 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.500 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.500 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.501 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.501 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.501 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.502 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.502 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.502 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.502 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.562 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] connecting to peer
23:48:10.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:10.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:10.564 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473) for tablet ad1717b59e6a4882bde027a3330b8294: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473
23:48:10.579 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.580 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.580 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.580 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.580 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.581 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.581 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.581 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.581 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.582 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.582 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.582 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.582 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468090591 for job 6446e0085b210020482ce7a622d23630.
23:48:10.602 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:10.603 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
23:48:10.639 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.640 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.640 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.640 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.640 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.641 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468090667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:10.677 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:10.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
23:48:10.753 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.755 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location master-127.3.230.252:37691(127.3.230.252:37691) for tablet Kudu Master: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.774 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.774 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.775 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.775 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.775 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.776 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.776 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.776 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.776 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.776 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.783584  5912 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:10.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.783987  5912 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:10.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.784123  5912 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.793031  5912 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.793190  5912 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.793277  5912 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.793336  5912 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.793418  5912 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:10.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.793478  5912 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37317/jwks.json
23:48:10.793 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.794 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.794 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.795 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.795 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.795 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.796 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.804929  5912 master_runner.cc:387] Master server non-default flags:
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.126:36941
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37317/jwks.json
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data/info.pb
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.126
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:10.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/logs
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:10.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:10.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.807111  5912 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:10.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.809271  5912 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:10.813 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.814 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.814 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.815 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.815 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.818 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.818 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.819533  5918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:10.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.820278  5919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:10.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.822109  5922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:10.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.823060  5912 server_base.cc:1061] running on GCE node
23:48:10.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.824085  5912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:10.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.825886  5912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:10.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.827159  5912 hybrid_clock.cc:648] HybridClock initialized: now 1783468090827081 us; error 64 us; skew 500 ppm
23:48:10.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.827611  5912 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:10.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.830506  5912 webserver.cc:534] Webserver started at http://127.5.195.126:42693/ using document root <none> and password file <none>
23:48:10.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.831420  5912 fs_manager.cc:362] Metadata directory not provided
23:48:10.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.831557  5912 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:10.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.831947  5912 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:10.833 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.834 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.834 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.834 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.834 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.834 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.834 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.834 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.835 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.835 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.835 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.835 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.834700  5912 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data/instance:
23:48:10.835 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d70e385587844c2cb8939416d8e62490"
23:48:10.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:10 on dist-test-slave-hfsf"
23:48:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.836087  5912 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal/instance:
23:48:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d70e385587844c2cb8939416d8e62490"
23:48:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:10 on dist-test-slave-hfsf"
23:48:10.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.843116  5912 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
23:48:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.846982  5927 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:10.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.848681  5912 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.848853  5912 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d70e385587844c2cb8939416d8e62490"
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:10 on dist-test-slave-hfsf"
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.849052  5912 fs_report.cc:389] FS layout report
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data/data
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:10.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:10.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.869573  5912 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:10.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.870565  5912 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:10.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.870860  5912 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:10.873 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.873 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.874 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.874 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.874 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.874 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.875 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.894690  5912 rpc_server.cc:307] RPC server started. Bound to: 127.5.195.126:36941
23:48:10.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.894709  5978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.195.126:36941 every 8 connection(s)
23:48:10.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.896613  5912 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/data/info.pb
23:48:10.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.901623  5979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.904124  5901 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 5912
23:48:10.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.904476  5901 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-0/wal/instance
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.906868  5901 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/logs
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data/info.pb
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.125:41211
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.125
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:10.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37317/jwks.json with env {}
23:48:10.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.908025  5979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } has no permanent_uuid. Determining permanent_uuid...
23:48:10.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.927559  5979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } has no permanent_uuid. Determining permanent_uuid...
23:48:10.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.929234  5931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.195.125:41211: connect: Connection refused (error 111)
23:48:10.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.931509  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.125:41211: Network error: Client connection negotiation failed: client connection to 127.5.195.125:41211: connect: Connection refused (error 111)
23:48:10.933 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.933 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.934 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.934 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.934 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.934 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.934 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.934 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.934 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.935 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.935 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.935 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.935 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:10.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:10.980921  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } attempt: 1
23:48:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:10.983353  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.125:41211: Network error: Client connection negotiation failed: client connection to 127.5.195.125:41211: connect: Connection refused (error 111)
23:48:10.994 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:10.994 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:10.995 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:10.995 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.995 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.995 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:10.995 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.995 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:10.996 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:10.996 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.018 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:11.019 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:11.019 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:11.019 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:11.019 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:11.019 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:11.020 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:11.020 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:11.019 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.020 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:11.020 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:11.020 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:11.020 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:11.020 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:11.020 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.020 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.020 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.020 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.021 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.021 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.021 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.021 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.021 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.051681  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } attempt: 2
23:48:11.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.053959  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.125:41211: Network error: Client connection negotiation failed: client connection to 127.5.195.125:41211: connect: Connection refused (error 111)
23:48:11.091 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468091091 for job 6446e0085b210020482ce7a622d23630.
23:48:11.102 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:11.104 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
23:48:11.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.145280  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } attempt: 3
23:48:11.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.147718  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.125:41211: Network error: Client connection negotiation failed: client connection to 127.5.195.125:41211: connect: Connection refused (error 111)
23:48:11.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468091167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:11.178 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:11.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
23:48:11.253 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.254 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.254 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.256 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.256 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.256 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.256 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.256 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.256 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.256 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.290300  5981 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.290645  5981 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.290728  5981 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:11.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.291002  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } attempt: 4
23:48:11.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.293313  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.125:41211: Network error: Client connection negotiation failed: client connection to 127.5.195.125:41211: connect: Connection refused (error 111)
23:48:11.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.299921  5981 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:11.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.300017  5981 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:11.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.300096  5981 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:11.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.300158  5981 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:11.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.300215  5981 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:11.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.300249  5981 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37317/jwks.json
23:48:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.311594  5981 master_runner.cc:387] Master server non-default flags:
23:48:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.125:41211
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37317/jwks.json
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data/info.pb
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.125
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/logs
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:11.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.313288  5981 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.315522  5981 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:11.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.324442  5990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:11.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.324497  5991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:11.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.325260  5993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:11.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.325874  5981 server_base.cc:1061] running on GCE node
23:48:11.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.326716  5981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.328426  5981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:11.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.329623  5981 hybrid_clock.cc:648] HybridClock initialized: now 1783468091329570 us; error 54 us; skew 500 ppm
23:48:11.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.329957  5981 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:11.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.332269  5981 webserver.cc:534] Webserver started at http://127.5.195.125:33607/ using document root <none> and password file <none>
23:48:11.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.333011  5981 fs_manager.cc:362] Metadata directory not provided
23:48:11.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.333102  5981 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:11.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.333415  5981 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:11.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.336045  5981 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data/instance:
23:48:11.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f79ef7e74f94031a381175df9f99f39"
23:48:11.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:11 on dist-test-slave-hfsf"
23:48:11.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.336959  5981 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal/instance:
23:48:11.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f79ef7e74f94031a381175df9f99f39"
23:48:11.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:11 on dist-test-slave-hfsf"
23:48:11.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.343024  5981 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
23:48:11.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.346974  5999 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.348600  5981 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.348763  5981 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f79ef7e74f94031a381175df9f99f39"
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:11 on dist-test-slave-hfsf"
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.349017  5981 fs_report.cc:389] FS layout report
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data/data
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:11.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.373682  5981 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:11.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.374631  5981 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:11.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.374950  5981 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.397607  5981 rpc_server.cc:307] RPC server started. Bound to: 127.5.195.125:41211
23:48:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.397624  6050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.195.125:41211 every 8 connection(s)
23:48:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.399284  5981 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/data/info.pb
23:48:11.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.404011  6051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:11.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.409425  5901 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 5981
23:48:11.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.409637  5901 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-1/wal/instance
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.410300  6051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } has no permanent_uuid. Determining permanent_uuid...
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.410864  5901 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/logs
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data/info.pb
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.124:40929
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.124
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:11.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37317/jwks.json with env {}
23:48:11.422 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.423 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.423 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.423 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location master-127.3.230.252:37691(127.3.230.252:37691) for tablet Kudu Master: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.430517  6051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } has no permanent_uuid. Determining permanent_uuid...
23:48:11.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.441638  6051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } has no permanent_uuid. Determining permanent_uuid...
23:48:11.442 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.443 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.443 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.444 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.444 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.444 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.444 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.444 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.444 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.443306  6003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.444 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.445 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.445 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.445 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.447584  6051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.462 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.463 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.464 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.464 [INFO - pool-74-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.464 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.465 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.465 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.465 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.466 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.482 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.483 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.483 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.483 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.483 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.485 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.493 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.494 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.494 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.494 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.494 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.495 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.495 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.495 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.496970  6051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 1
23:48:11.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.499454  6051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.502 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.502 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.503 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.503 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.503 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.503 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.504 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.504 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.504 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.522 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.522 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.523 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.524 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.567719  6051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 2
23:48:11.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.570155  6051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.579 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.580 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.580 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.580 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.580 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.580 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.581 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.581 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.582 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.582 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.582 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.582 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.582 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.583 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.583 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.583 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468091591 for job 6446e0085b210020482ce7a622d23630.
23:48:11.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.592599  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } attempt: 5
23:48:11.603 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:11.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.603431  5979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } has no permanent_uuid. Determining permanent_uuid...
23:48:11.606 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
23:48:11.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.608438  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.659719  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 1
23:48:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.661415  6051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 3
23:48:11.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.663266  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.664943  6051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468091668 for job bbc34d76ac15add629743db00c4f4a33.
23:48:11.678 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:11.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
23:48:11.702 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.703 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.703 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.703 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.703 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.703 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.704 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.704 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.704 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.704 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.704 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.731590  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 2
23:48:11.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.734043  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.809170  6051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 4
23:48:11.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.820778  6051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.839776  6054 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.840271  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 3
23:48:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.840515  6054 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.840651  6054 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.842677  5979 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.195.124:40929: Network error: Client connection negotiation failed: client connection to 127.5.195.124:40929: connect: Connection refused (error 111)
23:48:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.855861  6054 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.856026  6054 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.856138  6054 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.856204  6054 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.856292  6054 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.856392  6054 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37317/jwks.json
23:48:11.862 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:11.863 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:11.863 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:11.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:11.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:11.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:11.867 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:11.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.874519  6054 master_runner.cc:387] Master server non-default flags:
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.124:40929
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37317/jwks.json
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data/info.pb
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.124
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/logs
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:11.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.876967  6054 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:11.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.879730  6054 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:11.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.891945  6062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:11.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.895100  6054 server_base.cc:1061] running on GCE node
23:48:11.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.895562  6061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:11.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:11.896245  6064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:11.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.897339  6054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:11.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.899617  6054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:11.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.901041  6054 hybrid_clock.cc:648] HybridClock initialized: now 1783468091900908 us; error 120 us; skew 500 ppm
23:48:11.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.901522  6054 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:11.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.904599  6054 webserver.cc:534] Webserver started at http://127.5.195.124:44163/ using document root <none> and password file <none>
23:48:11.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.905632  6054 fs_manager.cc:362] Metadata directory not provided
23:48:11.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.905767  6054 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:11.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.906230  6054 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:11.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.909811  6054 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data/instance:
23:48:11.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bd54ce16edb94d8ebc024297731377ea"
23:48:11.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:11 on dist-test-slave-hfsf"
23:48:11.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.911003  6054 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal/instance:
23:48:11.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bd54ce16edb94d8ebc024297731377ea"
23:48:11.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:11 on dist-test-slave-hfsf"
23:48:11.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.919402  6054 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
23:48:11.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.924516  6071 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:11.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.926699  6054 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.926959  6054 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bd54ce16edb94d8ebc024297731377ea"
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:11 on dist-test-slave-hfsf"
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.927237  6054 fs_report.cc:389] FS layout report
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data/data
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:11.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:11.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.954180  6054 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.955662  6054 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.955992  6054 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:11.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.983644  6054 rpc_server.cc:307] RPC server started. Bound to: 127.5.195.124:40929
23:48:11.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.983664  6122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.195.124:40929 every 8 connection(s)
23:48:11.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.985663  6054 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/data/info.pb
23:48:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.990729  6123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.991333  5901 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6054
23:48:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.991542  5901 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/master-2/wal/instance
23:48:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:11.998955  6123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } has no permanent_uuid. Determining permanent_uuid...
23:48:12.013 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.014 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.014 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.016 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.016 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.016 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.017 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.019901  5979 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 4
23:48:12.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.029906  6123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } has no permanent_uuid. Determining permanent_uuid...
23:48:12.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.039265  5979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: Bootstrap starting.
23:48:12.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.041790  6123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } has no permanent_uuid. Determining permanent_uuid...
23:48:12.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.045743  5979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: Neither blocks nor log segments found. Creating new log.
23:48:12.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.047152  5979 log.cc:826] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: Log is configured to *not* fsync() on all Append() calls
23:48:12.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.052098  5979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: No bootstrap required, opened a new log
23:48:12.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.057761  6123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea: Bootstrap starting.
23:48:12.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.061043  5979 raft_consensus.cc:359] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.061448  5979 raft_consensus.cc:385] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:12.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.061573  5979 raft_consensus.cc:740] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d70e385587844c2cb8939416d8e62490, State: Initialized, Role: FOLLOWER
23:48:12.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.062407  5979 consensus_queue.cc:260] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.062743  6123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea: Neither blocks nor log segments found. Creating new log.
23:48:12.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.064707  6123 log.cc:826] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea: Log is configured to *not* fsync() on all Append() calls
23:48:12.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.066709  6134 sys_catalog.cc:455] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.068001  6134 sys_catalog.cc:458] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.068472  5979 sys_catalog.cc:565] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: configured and running, proceeding with master startup.
23:48:12.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.070456  6123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea: No bootstrap required, opened a new log
23:48:12.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.080852  6123 raft_consensus.cc:359] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.081583  6123 raft_consensus.cc:385] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:12.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.081871  6123 raft_consensus.cc:740] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd54ce16edb94d8ebc024297731377ea, State: Initialized, Role: FOLLOWER
23:48:12.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.082935  6123 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468092091 for job 6446e0085b210020482ce7a622d23630.
23:48:12.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.101805  6146 catalog_manager.cc:1593] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:12.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.102144  6146 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:12.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.085774  5912 master_runner.cc:187] Error getting master registration for 127.5.195.125:41211: OK, instance_id { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" instance_seqno: 1783468091391695 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:12.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.106220  5912 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:12.106 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:12.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.107201  6123 sys_catalog.cc:565] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: configured and running, proceeding with master startup.
23:48:12.108 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
23:48:12.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.113584  6147 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.114094  6147 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.120018  6051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } attempt: 5
23:48:12.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.123627  6147 raft_consensus.cc:493] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:12.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.123944  6147 raft_consensus.cc:515] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.124300  5933 tablet.cc:2406] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:12.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.125886  6147 leader_election.cc:290] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d70e385587844c2cb8939416d8e62490 (127.5.195.126:36941), 2f79ef7e74f94031a381175df9f99f39 (127.5.195.125:41211)
23:48:12.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.128559  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd54ce16edb94d8ebc024297731377ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d70e385587844c2cb8939416d8e62490" is_pre_election: true
23:48:12.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.129172  5954 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd54ce16edb94d8ebc024297731377ea in term 0.
23:48:12.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.130285  6073 leader_election.cc:304] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd54ce16edb94d8ebc024297731377ea, d70e385587844c2cb8939416d8e62490; no voters: 
23:48:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.131148  6147 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.131330  6147 raft_consensus.cc:493] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.131453  6147 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 0 FOLLOWER]: Advancing to term 1
23:48:12.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.139807  6147 raft_consensus.cc:515] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.141371  6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: Bootstrap starting.
23:48:12.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.142344  5954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd54ce16edb94d8ebc024297731377ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d70e385587844c2cb8939416d8e62490"
23:48:12.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.142593  5954 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 0 FOLLOWER]: Advancing to term 1
23:48:12.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.145998  5954 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd54ce16edb94d8ebc024297731377ea in term 1.
23:48:12.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.146968  6073 leader_election.cc:304] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd54ce16edb94d8ebc024297731377ea, d70e385587844c2cb8939416d8e62490; no voters: 
23:48:12.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.148593  6051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: Neither blocks nor log segments found. Creating new log.
23:48:12.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.152432  6051 log.cc:826] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: Log is configured to *not* fsync() on all Append() calls
23:48:12.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.155364  6158 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 1 FOLLOWER]: Leader election won for term 1
23:48:12.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.158007  6147 leader_election.cc:290] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [CANDIDATE]: Term 1 election: Requested vote from peers d70e385587844c2cb8939416d8e62490 (127.5.195.126:36941), 2f79ef7e74f94031a381175df9f99f39 (127.5.195.125:41211)
23:48:12.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.162961  6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: No bootstrap required, opened a new log
23:48:12.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468092167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:12.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.172143  6158 raft_consensus.cc:697] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [term 1 LEADER]: Becoming Leader. State: Replica: bd54ce16edb94d8ebc024297731377ea, State: Running, Role: LEADER
23:48:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.172955  6051 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.173074  6158 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.173574  6051 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:12.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.173840  6051 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f79ef7e74f94031a381175df9f99f39, State: Initialized, Role: FOLLOWER
23:48:12.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.174918  6051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } }
23:48:12.182 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.182 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.183 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.185 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.185 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.185 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.183 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.186 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.186 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.186 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.187 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=9 ms).
23:48:12.188 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
23:48:12.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.190764  6147 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd54ce16edb94d8ebc024297731377ea. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.191100  6147 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: This master's current role is: LEADER
23:48:12.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.199635  6165 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:48:12.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.200263  6166 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
23:48:12.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.207187  6163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.207657  6163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.208763  6077 tablet.cc:2406] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:12.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.209070  6051 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: configured and running, proceeding with master startup.
23:48:12.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.209128  6026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd54ce16edb94d8ebc024297731377ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f79ef7e74f94031a381175df9f99f39" is_pre_election: true
23:48:12.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.209724  6026 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd54ce16edb94d8ebc024297731377ea in term 0.
23:48:12.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.210685  6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd54ce16edb94d8ebc024297731377ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f79ef7e74f94031a381175df9f99f39"
23:48:12.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.211004  6025 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 0 FOLLOWER]: Advancing to term 1
23:48:12.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.214535  6025 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd54ce16edb94d8ebc024297731377ea in term 1.
23:48:12.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.213112  6054 master_runner.cc:187] Error getting master registration for 127.5.195.125:41211: OK, instance_id { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" instance_seqno: 1783468091391695 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:12.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.218674  6054 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.225227  6165 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:48:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.242349  6025 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [term 1 FOLLOWER]: Refusing update from remote peer bd54ce16edb94d8ebc024297731377ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.245299  6147 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
23:48:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.248540  5954 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [term 1 FOLLOWER]: Refusing update from remote peer bd54ce16edb94d8ebc024297731377ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.249588  6158 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:12.259 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.260 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.260 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.264 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.268563  6134 sys_catalog.cc:455] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd54ce16edb94d8ebc024297731377ea. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.268899  6134 sys_catalog.cc:458] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.273404  6134 sys_catalog.cc:455] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.273644  6134 sys_catalog.cc:458] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490 [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.274559  6172 mvcc.cc:204] Tried to move back new op lower bound from 7305085305811013632 to 7305085305548128256. Current Snapshot: MvccSnapshot[applied={T|T < 7305085305811013632}]
23:48:12.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.275573  6147 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.275861  6147 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: This master's current role is: LEADER
23:48:12.282 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.283 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.283 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.284 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.284 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.284 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.284 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.284 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.284 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.284 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.285777  6165 catalog_manager.cc:1382] Generated new cluster ID: 740cdb269d5e41febfb8a359c5bda2a0
23:48:12.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.285961  6165 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:48:12.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.289503  6163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd54ce16edb94d8ebc024297731377ea. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.289827  6163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.296197  6161 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.296552  6161 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea [sys.catalog]: This master's current role is: LEADER
23:48:12.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.299741  6163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd54ce16edb94d8ebc024297731377ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d70e385587844c2cb8939416d8e62490" member_type: VOTER last_known_addr { host: "127.5.195.126" port: 36941 } } peers { permanent_uuid: "2f79ef7e74f94031a381175df9f99f39" member_type: VOTER last_known_addr { host: "127.5.195.125" port: 41211 } } peers { permanent_uuid: "bd54ce16edb94d8ebc024297731377ea" member_type: VOTER last_known_addr { host: "127.5.195.124" port: 40929 } } }
23:48:12.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.299997  6163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39 [sys.catalog]: This master's current role is: FOLLOWER
23:48:12.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.302340  6178 mvcc.cc:204] Tried to move back new op lower bound from 7305085305811013632 to 7305085305548128256. Current Snapshot: MvccSnapshot[applied={T|T < 7305085305811013632}]
23:48:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.305889  6177 mvcc.cc:204] Tried to move back new op lower bound from 7305085305811013632 to 7305085305548128256. Current Snapshot: MvccSnapshot[applied={T|T < 7305085305811013632 or (T in {7305085305811013632})}]
23:48:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.307159  6185 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
23:48:12.318 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.319 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.319 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.319 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location master-127.3.230.252:37691(127.3.230.252:37691) for tablet Kudu Master: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.329243  6165 catalog_manager.cc:1405] Generated new certificate authority record
23:48:12.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.331182  6165 catalog_manager.cc:1539] Loading token signing keys...
23:48:12.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.338 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.338 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.338 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.338 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.338 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.338 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.338 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.339 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.339 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.339 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.339 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.357 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.358 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.358 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.361 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.361 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.361 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.362 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.362970  6165 catalog_manager.cc:6069] T 00000000000000000000000000000000 P bd54ce16edb94d8ebc024297731377ea: Generated new TSK 0
23:48:12.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.364276  6165 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:48:12.377 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.378 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.378 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.379 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.379 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:12.380 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:12.380 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:12.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:12.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:12.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:12.381 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.381 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.381 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.381 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.381 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.381 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.381 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.384593  5901 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/logs
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data/info.pb
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.65:0
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.195.65
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.65
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:12.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:12.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:12.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:12.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:12.386 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:12.386 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:12.386 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:12.399 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.399 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.400 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.401 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.401 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.401 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.402 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.418 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.418 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.420 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.420 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.420 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.420 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.421 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.421 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.437 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.437 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.438 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.440 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.440 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.440 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.440 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.440 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.477 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.477 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.478 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.478 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.478 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.478 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.478 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.478 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.478 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.478 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.479 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468092591 for job 6446e0085b210020482ce7a622d23630.
23:48:12.612 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
23:48:12.614 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
23:48:12.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468092667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:12.684 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:12.685 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
23:48:12.737 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.737 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.738 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.739 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.739 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.739 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.740 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.740 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.740 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.740 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.741 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.741 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.741 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.837785  6187 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.838160  6187 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:12.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.838289  6187 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.848013  6187 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:12.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.848274  6187 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.195.65
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.860193  6187 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.65:0
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data/info.pb
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.65
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.195.65
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/logs
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:12.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.863036  6187 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:12.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.865108  6187 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.877946  6193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.878715  6192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:12.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:12.880476  6195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:12.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.880847  6187 server_base.cc:1061] running on GCE node
23:48:12.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.881567  6187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:12.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.882908  6187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:12.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.884274  6187 hybrid_clock.cc:648] HybridClock initialized: now 1783468092884160 us; error 99 us; skew 500 ppm
23:48:12.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.884667  6187 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:12.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.887244  6187 webserver.cc:534] Webserver started at http://127.5.195.65:34167/ using document root <none> and password file <none>
23:48:12.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.888166  6187 fs_manager.cc:362] Metadata directory not provided
23:48:12.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.888316  6187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:12.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.888751  6187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.892390  6187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data/instance:
23:48:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3efe4d45f9194c6d8686d03b8f5ee41f"
23:48:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:12 on dist-test-slave-hfsf"
23:48:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.893438  6187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal/instance:
23:48:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3efe4d45f9194c6d8686d03b8f5ee41f"
23:48:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:12 on dist-test-slave-hfsf"
23:48:12.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.900498  6187 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
23:48:12.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.911810  6201 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:12.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.913877  6187 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.006s	sys 0.003s
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.918053  6187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3efe4d45f9194c6d8686d03b8f5ee41f"
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:12 on dist-test-slave-hfsf"
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.918390  6187 fs_report.cc:389] FS layout report
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data/data
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:12.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:12.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:12.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:12.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:12.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:12.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:12.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.947101  6187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:12.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.948189  6187 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:12.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.948582  6187 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:12.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.949864  6187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:12.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.951949  6187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:12.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.952091  6187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:12.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.952211  6187 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:12.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.952311  6187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:12.957 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:12.958 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:12.958 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:12.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.958 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.958 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:12.959 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.959 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.959 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:12.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:12.959 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.996546  6187 rpc_server.cc:307] RPC server started. Bound to: 127.5.195.65:44721
23:48:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.996577  6314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.195.65:44721 every 8 connection(s)
23:48:12.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:12.998487  6187 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/data/info.pb
23:48:13.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.004377  5901 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6187
23:48:13.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.004638  5901 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-0/wal/instance
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.016803  5901 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/logs
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data/info.pb
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.66:0
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.195.66
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.66
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.055466  6315 heartbeater.cc:344] Connected to a master server at 127.5.195.124:40929
23:48:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.055527  6316 heartbeater.cc:344] Connected to a master server at 127.5.195.126:36941
23:48:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.055621  6317 heartbeater.cc:344] Connected to a master server at 127.5.195.125:41211
23:48:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.055909  6317 heartbeater.cc:461] Registering TS with master...
23:48:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.055912  6316 heartbeater.cc:461] Registering TS with master...
23:48:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.055917  6315 heartbeater.cc:461] Registering TS with master...
23:48:13.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.057013  6317 heartbeater.cc:507] Master 127.5.195.125:41211 requested a full tablet report, sending...
23:48:13.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.057109  6315 heartbeater.cc:507] Master 127.5.195.124:40929 requested a full tablet report, sending...
23:48:13.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.058306  6316 heartbeater.cc:507] Master 127.5.195.126:36941 requested a full tablet report, sending...
23:48:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.059545  6088 ts_manager.cc:194] Registered new tserver with Master: 3efe4d45f9194c6d8686d03b8f5ee41f (127.5.195.65:44721)
23:48:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.059613  6016 ts_manager.cc:194] Registered new tserver with Master: 3efe4d45f9194c6d8686d03b8f5ee41f (127.5.195.65:44721)
23:48:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.060118  5943 ts_manager.cc:194] Registered new tserver with Master: 3efe4d45f9194c6d8686d03b8f5ee41f (127.5.195.65:44721)
23:48:13.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.061518  6088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.195.65:49961
23:48:13.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468093091 for job 6446e0085b210020482ce7a622d23630.
23:48:13.103 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:13.105 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
23:48:13.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.104832  6146 catalog_manager.cc:1294] Loaded cluster ID: 740cdb269d5e41febfb8a359c5bda2a0
23:48:13.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.104969  6146 catalog_manager.cc:1587] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: loading cluster ID for follower catalog manager: success
23:48:13.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.108201  6146 catalog_manager.cc:1609] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: acquiring CA information for follower catalog manager: success
23:48:13.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.110410  6146 catalog_manager.cc:1637] T 00000000000000000000000000000000 P d70e385587844c2cb8939416d8e62490: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:13.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468093167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:13.179 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:13.179 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
23:48:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.313314  6185 catalog_manager.cc:1294] Loaded cluster ID: 740cdb269d5e41febfb8a359c5bda2a0
23:48:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.313496  6185 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: loading cluster ID for follower catalog manager: success
23:48:13.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.318670  6185 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: acquiring CA information for follower catalog manager: success
23:48:13.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.323062  6185 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2f79ef7e74f94031a381175df9f99f39: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:13.402 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:13.402 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:13.403 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.404 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:13.405 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.405 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.405 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.405 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.406 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.406 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.406 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:13.434 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:13.434 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:13.435 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:13.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.435 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.436 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:13.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.466185  6323 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:13.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.466589  6323 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:13.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.466724  6323 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:13.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.476138  6323 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:13.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.476383  6323 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.195.66
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.487376  6323 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.66:0
23:48:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data/info.pb
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.66
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.195.66
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/logs
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:13.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:13.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.489476  6323 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:13.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.491653  6323 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:13.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.502316  6331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:13.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.502439  6332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:13.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.507822  6323 server_base.cc:1061] running on GCE node
23:48:13.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:13.508044  6334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:13.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.508854  6323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:13.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.510129  6323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:13.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.511379  6323 hybrid_clock.cc:648] HybridClock initialized: now 1783468093511311 us; error 60 us; skew 500 ppm
23:48:13.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.511816  6323 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:13.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.514580  6323 webserver.cc:534] Webserver started at http://127.5.195.66:46115/ using document root <none> and password file <none>
23:48:13.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.515499  6323 fs_manager.cc:362] Metadata directory not provided
23:48:13.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.515647  6323 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:13.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.516047  6323 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.518787  6323 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data/instance:
23:48:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c3f013f8ac664ac0b15edcdaed3bc059"
23:48:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:13 on dist-test-slave-hfsf"
23:48:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.519747  6323 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal/instance:
23:48:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c3f013f8ac664ac0b15edcdaed3bc059"
23:48:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:13 on dist-test-slave-hfsf"
23:48:13.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.526535  6323 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
23:48:13.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.531622  6340 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.533420  6323 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:48:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.533646  6323 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal
23:48:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c3f013f8ac664ac0b15edcdaed3bc059"
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:13 on dist-test-slave-hfsf"
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.533932  6323 fs_report.cc:389] FS layout report
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data/data
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:13.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.556944  6323 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:13.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.557929  6323 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:13.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.558275  6323 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:13.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.559618  6323 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:13.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.561456  6323 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:13.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.561591  6323 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:13.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.561700  6323 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:13.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.561789  6323 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:13.593 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468093592 for job 6446e0085b210020482ce7a622d23630.
23:48:13.597 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:13.598 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:13.598 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:13.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.600 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.601 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.601 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.601 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:13.607 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:13.608 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
23:48:13.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.633985  6323 rpc_server.cc:307] RPC server started. Bound to: 127.5.195.66:38627
23:48:13.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.634057  6453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.195.66:38627 every 8 connection(s)
23:48:13.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.636627  6323 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/data/info.pb
23:48:13.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.646298  5901 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6323
23:48:13.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.646552  5901 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-1/wal/instance
23:48:13.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468093667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:13.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.670701  5901 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/logs
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data/info.pb
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.67:0
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.195.67
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.67
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:13.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:13.684 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:48:13.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.685519  6455 heartbeater.cc:344] Connected to a master server at 127.5.195.126:36941
23:48:13.685 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
23:48:13.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.686004  6455 heartbeater.cc:461] Registering TS with master...
23:48:13.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.687557  6455 heartbeater.cc:507] Master 127.5.195.126:36941 requested a full tablet report, sending...
23:48:13.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.689899  5943 ts_manager.cc:194] Registered new tserver with Master: c3f013f8ac664ac0b15edcdaed3bc059 (127.5.195.66:38627)
23:48:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.700929  6460 heartbeater.cc:344] Connected to a master server at 127.5.195.125:41211
23:48:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.701143  6460 heartbeater.cc:461] Registering TS with master...
23:48:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.701782  6460 heartbeater.cc:507] Master 127.5.195.125:41211 requested a full tablet report, sending...
23:48:13.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.703565  6016 ts_manager.cc:194] Registered new tserver with Master: c3f013f8ac664ac0b15edcdaed3bc059 (127.5.195.66:38627)
23:48:13.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.704557  6454 heartbeater.cc:344] Connected to a master server at 127.5.195.124:40929
23:48:13.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.704706  6454 heartbeater.cc:461] Registering TS with master...
23:48:13.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.705271  6454 heartbeater.cc:507] Master 127.5.195.124:40929 requested a full tablet report, sending...
23:48:13.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.707094  6088 ts_manager.cc:194] Registered new tserver with Master: c3f013f8ac664ac0b15edcdaed3bc059 (127.5.195.66:38627)
23:48:13.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:13.708432  6088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.195.66:47675
23:48:13.937 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:13.938 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:13.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.938 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:13.938 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.938 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:13.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:13.939 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:13.939 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:14.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.065167  6315 heartbeater.cc:499] Master 127.5.195.124:40929 was elected leader, sending a full tablet report...
23:48:14.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468094091 for job 6446e0085b210020482ce7a622d23630.
23:48:14.103 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:14.104 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
23:48:14.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.112993  6462 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:14.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.113327  6462 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:14.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.113415  6462 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:14.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.122434  6462 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:14.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.122606  6462 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.195.67
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.133644  6462 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.195.84:36983
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.195.67:0
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data/info.pb
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.195.67
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.195.126:36941,127.5.195.125:41211,127.5.195.124:40929
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.195.67
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/logs
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:14.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:14.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.135625  6462 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:14.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.137846  6462 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:14.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.148864  6468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:14.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.148865  6469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:14.152046  6471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:14.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.152211  6462 server_base.cc:1061] running on GCE node
23:48:14.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.153376  6462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:14.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.154920  6462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:14.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.156464  6462 hybrid_clock.cc:648] HybridClock initialized: now 1783468094156363 us; error 70 us; skew 500 ppm
23:48:14.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.156921  6462 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:14.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.160597  6462 webserver.cc:534] Webserver started at http://127.5.195.67:39631/ using document root <none> and password file <none>
23:48:14.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.161738  6462 fs_manager.cc:362] Metadata directory not provided
23:48:14.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.161891  6462 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:14.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.162374  6462 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:14.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.166139  6462 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data/instance:
23:48:14.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f3fde060d3504b499957cf300a35fe9d"
23:48:14.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:14 on dist-test-slave-hfsf"
23:48:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.167351  6462 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal/instance:
23:48:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f3fde060d3504b499957cf300a35fe9d"
23:48:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:14 on dist-test-slave-hfsf"
23:48:14.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468094167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:14.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.175582  6462 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.003s
23:48:14.177 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:14.178 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
23:48:14.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.180256  6477 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.181957  6462 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.003s
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.182119  6462 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f3fde060d3504b499957cf300a35fe9d"
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:14 on dist-test-slave-hfsf"
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.182358  6462 fs_report.cc:389] FS layout report
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data/data
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:14.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.215504  6462 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:14.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.216403  6462 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:14.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.216676  6462 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:14.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.217782  6462 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:14.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.219946  6462 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:14.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.220050  6462 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:14.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.220129  6462 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:14.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.220175  6462 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:14.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.260246  6462 rpc_server.cc:307] RPC server started. Bound to: 127.5.195.67:33791
23:48:14.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.260291  6590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.195.67:33791 every 8 connection(s)
23:48:14.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.261957  6462 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/data/info.pb
23:48:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.263543  5901 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6462
23:48:14.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.263753  5901 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster11844224495862757034/ts-2/wal/instance
23:48:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.307317  6592 heartbeater.cc:344] Connected to a master server at 127.5.195.126:36941
23:48:14.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.307811  6592 heartbeater.cc:461] Registering TS with master...
23:48:14.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.308054  6593 heartbeater.cc:344] Connected to a master server at 127.5.195.125:41211
23:48:14.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.308214  6593 heartbeater.cc:461] Registering TS with master...
23:48:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.309121  6593 heartbeater.cc:507] Master 127.5.195.125:41211 requested a full tablet report, sending...
23:48:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.309309  6592 heartbeater.cc:507] Master 127.5.195.126:36941 requested a full tablet report, sending...
23:48:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.311214  6591 heartbeater.cc:344] Connected to a master server at 127.5.195.124:40929
23:48:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.311231  6016 ts_manager.cc:194] Registered new tserver with Master: f3fde060d3504b499957cf300a35fe9d (127.5.195.67:33791)
23:48:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.311337  6591 heartbeater.cc:461] Registering TS with master...
23:48:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.311400  5943 ts_manager.cc:194] Registered new tserver with Master: f3fde060d3504b499957cf300a35fe9d (127.5.195.67:33791)
23:48:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.311869  6591 heartbeater.cc:507] Master 127.5.195.124:40929 requested a full tablet report, sending...
23:48:14.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.312909  6088 ts_manager.cc:194] Registered new tserver with Master: f3fde060d3504b499957cf300a35fe9d (127.5.195.67:33791)
23:48:14.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.313898  6088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.195.67:59337
23:48:14.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.320832  5901 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:14.324 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:14.324 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:14.325 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.5.195.126"
      port: 36941
    }
    bound_http_address {
      host: "127.5.195.126"
      port: 42693
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.5.195.125"
      port: 41211
    }
    bound_http_address {
      host: "127.5.195.125"
      port: 33607
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.5.195.124"
      port: 40929
    }
    bound_http_address {
      host: "127.5.195.124"
      port: 44163
    }
  }
}

23:48:14.325 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:14.326 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.5.195.65"
      port: 44721
    }
    bound_http_address {
      host: "127.5.195.65"
      port: 34167
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.5.195.66"
      port: 38627
    }
    bound_http_address {
      host: "127.5.195.66"
      port: 46115
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.5.195.67"
      port: 33791
    }
    bound_http_address {
      host: "127.5.195.67"
      port: 39631
    }
  }
}

23:48:14.326 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:14.328 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:14.328 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:48:14.328 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:48:14.328 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:48:14.329 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:48:14.332 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:48:14.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468094591 for job 6446e0085b210020482ce7a622d23630.
23:48:14.601 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:14.602 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
23:48:14.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468094668 for job bbc34d76ac15add629743db00c4f4a33.
23:48:14.678 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:14.679 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
23:48:14.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.712077  6454 heartbeater.cc:499] Master 127.5.195.124:40929 was elected leader, sending a full tablet report...
23:48:14.712 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:14.712 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:48:14.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.715461  6601 mini_oidc.cc:150] Starting JWKS server
23:48:14.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.718008  6601 webserver.cc:534] Webserver started at http://127.0.0.1:44715/ using document root <none> and password file <none>
23:48:14.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.718284  6601 mini_oidc.cc:186] Starting OIDC Discovery server
23:48:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.719020  6601 webserver.cc:534] Webserver started at http://127.0.0.1:39779/ using document root <none> and password file <none>
23:48:14.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:48:14.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:14Z Disabled control of system clock
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:14.751832  6601 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/logs
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data/info.pb
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.126:40573
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.126
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44715/jwks.json with env {}
23:48:15.042 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:15.043 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:15.043 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:15.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.044 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:15.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468095091 for job 6446e0085b210020482ce7a622d23630.
23:48:15.102 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:15.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
23:48:15.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.126235  6613 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:15.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.126574  6613 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:15.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.126657  6613 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.136305  6613 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.136411  6613 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.136468  6613 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.136508  6613 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.136561  6613 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.136595  6613 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44715/jwks.json
23:48:15.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.147593  6613 master_runner.cc:387] Master server non-default flags:
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.126:40573
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44715/jwks.json
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data/info.pb
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.126
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/logs
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:15.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.149715  6613 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:15.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.151814  6613 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:15.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.161888  6619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:15.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.162019  6618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:15.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.162947  6621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:15.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.164757  6613 server_base.cc:1061] running on GCE node
23:48:15.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.165753  6613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:15.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.167549  6613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:15.167 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468095167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.168835  6613 hybrid_clock.cc:648] HybridClock initialized: now 1783468095168744 us; error 79 us; skew 500 ppm
23:48:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.169327  6613 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:15.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.175253  6613 webserver.cc:534] Webserver started at http://127.6.114.126:35585/ using document root <none> and password file <none>
23:48:15.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.176426  6613 fs_manager.cc:362] Metadata directory not provided
23:48:15.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.176579  6613 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:15.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.177124  6613 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:15.178 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:15.179 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
23:48:15.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.180804  6613 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data/instance:
23:48:15.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f92f47c51b7447558a0b791af3270a64"
23:48:15.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:15 on dist-test-slave-hfsf"
23:48:15.182 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:15.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.181947  6613 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal/instance:
23:48:15.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f92f47c51b7447558a0b791af3270a64"
23:48:15.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:15 on dist-test-slave-hfsf"
23:48:15.182 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:15.183 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.183 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:15.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.184 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:15.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.189095  6613 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
23:48:15.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.193094  6627 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:15.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.194605  6613 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.194936  6613 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f92f47c51b7447558a0b791af3270a64"
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:15 on dist-test-slave-hfsf"
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.195228  6613 fs_report.cc:389] FS layout report
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data/data
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:15.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.215888  6613 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:15.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.216897  6613 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:15.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.217243  6613 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:15.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.240736  6613 rpc_server.cc:307] RPC server started. Bound to: 127.6.114.126:40573
23:48:15.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.240756  6678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.114.126:40573 every 8 connection(s)
23:48:15.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.242389  6613 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/data/info.pb
23:48:15.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.247041  6679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:15.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.251048  6601 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6613
23:48:15.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.251418  6601 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-0/wal/instance
23:48:15.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.254570  6601 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:15.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:15.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal
23:48:15.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data
23:48:15.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:15.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/logs
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data/info.pb
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.125:39367
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.125
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:15.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44715/jwks.json with env {}
23:48:15.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.255405  6679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } has no permanent_uuid. Determining permanent_uuid...
23:48:15.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.277161  6679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } has no permanent_uuid. Determining permanent_uuid...
23:48:15.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.278600  6631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.114.125:39367: connect: Connection refused (error 111)
23:48:15.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.280700  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.125:39367: Network error: Client connection negotiation failed: client connection to 127.6.114.125:39367: connect: Connection refused (error 111)
23:48:15.298 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:15.299 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:15.299 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:15.299 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:15.299 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:15.299 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:15.299 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:15.300 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:15.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:15.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:15.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:15.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:15.300 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:15.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.317164  6591 heartbeater.cc:499] Master 127.5.195.124:40929 was elected leader, sending a full tablet report...
23:48:15.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.330088  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } attempt: 1
23:48:15.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.332888  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.125:39367: Network error: Client connection negotiation failed: client connection to 127.6.114.125:39367: connect: Connection refused (error 111)
23:48:15.399 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:15.400 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:15.400 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:15.401 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.401 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.401 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.401 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.402 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:15.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.402514  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } attempt: 2
23:48:15.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.404822  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.125:39367: Network error: Client connection negotiation failed: client connection to 127.6.114.125:39367: connect: Connection refused (error 111)
23:48:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.496131  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } attempt: 3
23:48:15.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.499172  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.125:39367: Network error: Client connection negotiation failed: client connection to 127.6.114.125:39367: connect: Connection refused (error 111)
23:48:15.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468095591 for job 6446e0085b210020482ce7a622d23630.
23:48:15.603 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:15.604 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
23:48:15.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.642470  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } attempt: 4
23:48:15.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.644984  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.125:39367: Network error: Client connection negotiation failed: client connection to 127.6.114.125:39367: connect: Connection refused (error 111)
23:48:15.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.655031  6681 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:15.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.655465  6681 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:15.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.655594  6681 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:15.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.664386  6681 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:15.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.664541  6681 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:15.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.664625  6681 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:15.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.664681  6681 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:15.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.664760  6681 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:15.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.664814  6681 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44715/jwks.json
23:48:15.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468095667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:15.677 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.678292  6681 master_runner.cc:387] Master server non-default flags:
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:15.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.125:39367
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44715/jwks.json
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data/info.pb
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.125
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/logs
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.681892  6681 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:15.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.684258  6681 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:15.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.702258  6693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:15.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.703197  6692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:15.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.712502  6695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:15.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.712730  6681 server_base.cc:1061] running on GCE node
23:48:15.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.714241  6681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:15.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.716771  6681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:15.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.718246  6681 hybrid_clock.cc:648] HybridClock initialized: now 1783468095718148 us; error 144 us; skew 500 ppm
23:48:15.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.718779  6681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.721946  6681 webserver.cc:534] Webserver started at http://127.6.114.125:36599/ using document root <none> and password file <none>
23:48:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.723197  6681 fs_manager.cc:362] Metadata directory not provided
23:48:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.723366  6681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.723856  6681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:15.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.726890  6681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data/instance:
23:48:15.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a77f74330b04aad85788cfedf860739"
23:48:15.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:15 on dist-test-slave-hfsf"
23:48:15.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.727888  6681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal/instance:
23:48:15.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a77f74330b04aad85788cfedf860739"
23:48:15.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:15 on dist-test-slave-hfsf"
23:48:15.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.734784  6681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
23:48:15.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.739588  6701 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:15.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.741415  6681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
23:48:15.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.741654  6681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a77f74330b04aad85788cfedf860739"
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:15 on dist-test-slave-hfsf"
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.741946  6681 fs_report.cc:389] FS layout report
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data/data
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:15.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.782614  6681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:15.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.783654  6681 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:15.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.784014  6681 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:15.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.816720  6681 rpc_server.cc:307] RPC server started. Bound to: 127.6.114.125:39367
23:48:15.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.816741  6752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.114.125:39367 every 8 connection(s)
23:48:15.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.818951  6681 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/data/info.pb
23:48:15.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.821774  6601 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6681
23:48:15.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.822026  6601 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-1/wal/instance
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.824613  6601 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/logs
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data/info.pb
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.124:34801
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.124
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:15.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44715/jwks.json with env {}
23:48:15.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.837247  6753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:15.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.849638  6753 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } has no permanent_uuid. Determining permanent_uuid...
23:48:15.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.892901  6753 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } has no permanent_uuid. Determining permanent_uuid...
23:48:15.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.909198  6753 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } has no permanent_uuid. Determining permanent_uuid...
23:48:15.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.910485  6704 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:15.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.912585  6753 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:15.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.944376  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } attempt: 5
23:48:15.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.953457  6679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } has no permanent_uuid. Determining permanent_uuid...
23:48:15.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.956209  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:15.957 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:15.958 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:15.958 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.958 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:15.959 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.959 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:15.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:15.961 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.961 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.961 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:15.961 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:15.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:15.961989  6753 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 1
23:48:15.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:15.964315  6753 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.007485  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 1
23:48:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.010638  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.032681  6753 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 2
23:48:16.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.036176  6753 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.078913  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 2
23:48:16.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.081507  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468096091 for job 6446e0085b210020482ce7a622d23630.
23:48:16.102 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:16.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
23:48:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.127467  6753 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 3
23:48:16.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.130183  6753 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468096167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:16.178 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:16.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
23:48:16.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.187779  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 3
23:48:16.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.190363  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.270578  6755 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:16.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.271025  6755 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:16.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.271158  6755 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:16.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.273425  6753 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 4
23:48:16.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.275820  6753 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.281334  6755 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:16.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.281479  6755 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:16.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.281566  6755 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:16.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.281632  6755 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:16.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.281714  6755 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:16.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.281772  6755 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44715/jwks.json
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.293264  6755 master_runner.cc:387] Master server non-default flags:
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.124:34801
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44715/jwks.json
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data/info.pb
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.124
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/logs
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:16.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.295444  6755 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.297559  6755 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:16.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.307830  6765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:16.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.307889  6764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.308912  6767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.309216  6755 server_base.cc:1061] running on GCE node
23:48:16.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.310204  6755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:16.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.311831  6755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:16.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.313081  6755 hybrid_clock.cc:648] HybridClock initialized: now 1783468096313026 us; error 49 us; skew 500 ppm
23:48:16.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.313436  6755 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:16.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.317916  6755 webserver.cc:534] Webserver started at http://127.6.114.124:35573/ using document root <none> and password file <none>
23:48:16.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.318966  6755 fs_manager.cc:362] Metadata directory not provided
23:48:16.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.319115  6755 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:16.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.319518  6755 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:16.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.322661  6755 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data/instance:
23:48:16.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0723c7cc142a4119b870cd3b55e17502"
23:48:16.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:16 on dist-test-slave-hfsf"
23:48:16.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.323789  6755 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal/instance:
23:48:16.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0723c7cc142a4119b870cd3b55e17502"
23:48:16.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:16 on dist-test-slave-hfsf"
23:48:16.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.330339  6755 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:48:16.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.334542  6773 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.336848  6755 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.337076  6755 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0723c7cc142a4119b870cd3b55e17502"
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:16 on dist-test-slave-hfsf"
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.337322  6755 fs_report.cc:389] FS layout report
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data/data
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:16.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.359244  6755 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:16.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.360280  6755 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:16.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.360523  6755 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:16.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.367647  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 4
23:48:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.370252  6679 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.114.124:34801: Network error: Client connection negotiation failed: client connection to 127.6.114.124:34801: connect: Connection refused (error 111)
23:48:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.383701  6755 rpc_server.cc:307] RPC server started. Bound to: 127.6.114.124:34801
23:48:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.383731  6824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.114.124:34801 every 8 connection(s)
23:48:16.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.385445  6755 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/data/info.pb
23:48:16.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.390515  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:16.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.394429  6601 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6755
23:48:16.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.394775  6601 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/master-2/wal/instance
23:48:16.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.396976  6825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } has no permanent_uuid. Determining permanent_uuid...
23:48:16.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.427129  6825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } has no permanent_uuid. Determining permanent_uuid...
23:48:16.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.439725  6825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } has no permanent_uuid. Determining permanent_uuid...
23:48:16.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.453223  6825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: Bootstrap starting.
23:48:16.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.457389  6825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: Neither blocks nor log segments found. Creating new log.
23:48:16.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.458496  6825 log.cc:826] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: Log is configured to *not* fsync() on all Append() calls
23:48:16.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.461402  6825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: No bootstrap required, opened a new log
23:48:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.468448  6825 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.469159  6825 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.469326  6825 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0723c7cc142a4119b870cd3b55e17502, State: Initialized, Role: FOLLOWER
23:48:16.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.470043  6825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.471222  6835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.471581  6835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.472255  6825 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: configured and running, proceeding with master startup.
23:48:16.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.483616  6846 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:16.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.483834  6846 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:16.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.481385  6755 master_runner.cc:187] Error getting master registration for 127.6.114.126:40573: OK, instance_id { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" instance_seqno: 1783468095234140 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:16.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.488641  6755 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:16.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.575050  6753 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 5
23:48:16.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.587955  6753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: Bootstrap starting.
23:48:16.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468096591 for job 6446e0085b210020482ce7a622d23630.
23:48:16.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.592803  6753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: Neither blocks nor log segments found. Creating new log.
23:48:16.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.594273  6753 log.cc:826] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: Log is configured to *not* fsync() on all Append() calls
23:48:16.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.599596  6753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: No bootstrap required, opened a new log
23:48:16.611 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
23:48:16.612 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
23:48:16.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.612807  6779 tablet.cc:2406] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:16.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.612938  6753 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.613327  6753 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:16.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.613458  6753 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a77f74330b04aad85788cfedf860739, State: Initialized, Role: FOLLOWER
23:48:16.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.614367  6753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.615682  6849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.616129  6849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.617108  6753 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: configured and running, proceeding with master startup.
23:48:16.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.634989  6860 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:16.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.635491  6860 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:16.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.636102  6681 master_runner.cc:187] Error getting master registration for 127.6.114.126:40573: OK, instance_id { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" instance_seqno: 1783468095234140 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:16.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.644032  6681 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:16.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.647563  6679 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } attempt: 5
23:48:16.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.664004  6679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: Bootstrap starting.
23:48:16.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468096667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:16.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.669103  6679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: Neither blocks nor log segments found. Creating new log.
23:48:16.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.671118  6679 log.cc:826] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: Log is configured to *not* fsync() on all Append() calls
23:48:16.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.678658  6835 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:16.679 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:16.680 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:16.680 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:16.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.683339  6835 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.683521  6679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: No bootstrap required, opened a new log
23:48:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.685657  6835 leader_election.cc:290] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f92f47c51b7447558a0b791af3270a64 (127.6.114.126:40573), 4a77f74330b04aad85788cfedf860739 (127.6.114.125:39367)
23:48:16.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.692162  6679 raft_consensus.cc:359] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.692795  6679 raft_consensus.cc:385] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:16.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.693038  6679 raft_consensus.cc:740] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f92f47c51b7447558a0b791af3270a64, State: Initialized, Role: FOLLOWER
23:48:16.693 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.693 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.693 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.693 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:16.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.694511  6679 consensus_queue.cc:260] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.696018  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0723c7cc142a4119b870cd3b55e17502" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a77f74330b04aad85788cfedf860739" is_pre_election: true
23:48:16.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.696620  6728 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0723c7cc142a4119b870cd3b55e17502 in term 0.
23:48:16.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.700366  6777 leader_election.cc:304] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0723c7cc142a4119b870cd3b55e17502, 4a77f74330b04aad85788cfedf860739; no voters: 
23:48:16.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.701800  6863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.703377  6835 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:16.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.704542  6863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.704402  6679 sys_catalog.cc:565] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: configured and running, proceeding with master startup.
23:48:16.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.705399  6654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0723c7cc142a4119b870cd3b55e17502" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f92f47c51b7447558a0b791af3270a64" is_pre_election: true
23:48:16.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.706024  6654 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0723c7cc142a4119b870cd3b55e17502 in term 0.
23:48:16.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.707496  6835 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:16.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.707738  6835 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 0 FOLLOWER]: Advancing to term 1
23:48:16.710 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=42 ms, finalizationTime=1 ms).
23:48:16.711 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
23:48:16.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.720796  6633 tablet.cc:2406] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:16.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.729732  6835 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.737079  6654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0723c7cc142a4119b870cd3b55e17502" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f92f47c51b7447558a0b791af3270a64"
23:48:16.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.737360  6654 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 0 FOLLOWER]: Advancing to term 1
23:48:16.742 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:16.743 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:16.743 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:16.744 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.744 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.744 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.745 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.745 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.745 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.745 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.745 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.746 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.746 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:16.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.746948  6654 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0723c7cc142a4119b870cd3b55e17502 in term 1.
23:48:16.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.747860  6776 leader_election.cc:304] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0723c7cc142a4119b870cd3b55e17502, f92f47c51b7447558a0b791af3270a64; no voters: 
23:48:16.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.751381  6870 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 1 FOLLOWER]: Leader election won for term 1
23:48:16.754 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:16.755 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:16.755 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:16.756 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.756 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.758 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.758 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.758 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.758 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:16.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.752192  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0723c7cc142a4119b870cd3b55e17502" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a77f74330b04aad85788cfedf860739"
23:48:16.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.752439  6728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 0 FOLLOWER]: Advancing to term 1
23:48:16.759 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:16.759 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:16.760 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:16.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:16.761 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.761 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.761 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:16.761 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.762 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.762 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:16.762 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.762389  6870 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [term 1 LEADER]: Becoming Leader. State: Replica: 0723c7cc142a4119b870cd3b55e17502, State: Running, Role: LEADER
23:48:16.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.763329  6870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } }
23:48:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.769903  6728 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0723c7cc142a4119b870cd3b55e17502 in term 1.
23:48:16.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.777014  6835 leader_election.cc:290] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [CANDIDATE]: Term 1 election: Requested vote from peers f92f47c51b7447558a0b791af3270a64 (127.6.114.126:40573), 4a77f74330b04aad85788cfedf860739 (127.6.114.125:39367)
23:48:16.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.777733  6877 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
23:48:16.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:16.787120  6707 tablet.cc:2406] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:16.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.788182  6872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0723c7cc142a4119b870cd3b55e17502. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.788633  6872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: This master's current role is: LEADER
23:48:16.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.796067  6878 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:48:16.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.799180  6878 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:48:16.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.867283  6728 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [term 1 FOLLOWER]: Refusing update from remote peer 0723c7cc142a4119b870cd3b55e17502: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:16.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.868943  6654 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [term 1 FOLLOWER]: Refusing update from remote peer 0723c7cc142a4119b870cd3b55e17502: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:16.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.870927  6872 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.872946  6872 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:16.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.903558  6849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0723c7cc142a4119b870cd3b55e17502. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.903842  6849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.906418  6863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0723c7cc142a4119b870cd3b55e17502. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.906682  6863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.911028  6879 mvcc.cc:204] Tried to move back new op lower bound from 7305085324722745344 to 7305085324350185472. Current Snapshot: MvccSnapshot[applied={T|T < 7305085324722745344}]
23:48:16.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.918968  6849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.919225  6849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.930519  6870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.930917  6870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: This master's current role is: LEADER
23:48:16.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.931591  6870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.931802  6870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502 [sys.catalog]: This master's current role is: LEADER
23:48:16.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.939389  6863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0723c7cc142a4119b870cd3b55e17502" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f92f47c51b7447558a0b791af3270a64" member_type: VOTER last_known_addr { host: "127.6.114.126" port: 40573 } } peers { permanent_uuid: "4a77f74330b04aad85788cfedf860739" member_type: VOTER last_known_addr { host: "127.6.114.125" port: 39367 } } peers { permanent_uuid: "0723c7cc142a4119b870cd3b55e17502" member_type: VOTER last_known_addr { host: "127.6.114.124" port: 34801 } } }
23:48:16.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.939640  6863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64 [sys.catalog]: This master's current role is: FOLLOWER
23:48:16.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.943097  6878 catalog_manager.cc:1382] Generated new cluster ID: 7a9858c18b2841f39becbd60318d2045
23:48:16.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.943224  6878 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:48:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.967096  6878 catalog_manager.cc:1405] Generated new certificate authority record
23:48:16.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:16.969800  6878 catalog_manager.cc:1539] Loading token signing keys...
23:48:17.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.013537  6878 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 0723c7cc142a4119b870cd3b55e17502: Generated new TSK 0
23:48:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.015072  6878 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:48:17.015 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [3ms] received response from server master-127.2.42.124:36407: OK, deferred=null) with no deferred attached!
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.045650  6601 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/logs
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data/info.pb
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.65:0
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.114.65
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.65
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:17.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468097091 for job 6446e0085b210020482ce7a622d23630.
23:48:17.109 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
23:48:17.110 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
23:48:17.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468097167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:17.178 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:17.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
23:48:17.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.500587  6887 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:17.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.500936  6887 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:17.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.501029  6887 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.511528  6887 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.511786  6887 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.114.65
23:48:17.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.524230  6887 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.65:0
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data/info.pb
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.65
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.114.65
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/logs
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:17.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:17.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.526748  6887 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:17.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.529452  6887 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:17.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.540737  6892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:17.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.540773  6893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:17.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:17.541649  6895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:17.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.542317  6887 server_base.cc:1061] running on GCE node
23:48:17.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.543237  6887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:17.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.544683  6887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:17.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.545996  6887 hybrid_clock.cc:648] HybridClock initialized: now 1783468097545885 us; error 74 us; skew 500 ppm
23:48:17.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.546336  6887 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:17.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.549116  6887 webserver.cc:534] Webserver started at http://127.6.114.65:41515/ using document root <none> and password file <none>
23:48:17.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.550019  6887 fs_manager.cc:362] Metadata directory not provided
23:48:17.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.550132  6887 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:17.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.550478  6887 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:17.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.553404  6887 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data/instance:
23:48:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1228d72bb77941ef982d60ce38a833cf"
23:48:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:17 on dist-test-slave-hfsf"
23:48:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.554426  6887 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal/instance:
23:48:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1228d72bb77941ef982d60ce38a833cf"
23:48:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:17 on dist-test-slave-hfsf"
23:48:17.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.562189  6887 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
23:48:17.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.566665  6902 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:17.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.568492  6887 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:17.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.568677  6887 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1228d72bb77941ef982d60ce38a833cf"
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:17 on dist-test-slave-hfsf"
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.568892  6887 fs_report.cc:389] FS layout report
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data/data
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:17.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.585628  6887 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.586570  6887 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.586938  6887 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:17.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.588140  6887 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.590061  6887 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.590159  6887 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.590240  6887 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.590291  6887 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:17.591 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468097591 for job 6446e0085b210020482ce7a622d23630.
23:48:17.603 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:17.604 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
23:48:17.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.639027  6860 catalog_manager.cc:1294] Loaded cluster ID: 7a9858c18b2841f39becbd60318d2045
23:48:17.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.639529  6860 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: loading cluster ID for follower catalog manager: success
23:48:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.645519  6860 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: acquiring CA information for follower catalog manager: success
23:48:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.649513  6860 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 4a77f74330b04aad85788cfedf860739: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:17.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468097667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:17.678 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:17.679 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
23:48:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.688493  6887 rpc_server.cc:307] RPC server started. Bound to: 127.6.114.65:39287
23:48:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.688548  7014 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.114.65:39287 every 8 connection(s)
23:48:17.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.690052  6887 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/data/info.pb
23:48:17.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.695326  6601 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 6887
23:48:17.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.695605  6601 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-0/wal/instance
23:48:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.702526  6601 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal
23:48:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data
23:48:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/logs
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data/info.pb
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.66:0
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.114.66
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.66
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:17.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.723887  7017 heartbeater.cc:344] Connected to a master server at 127.6.114.125:39367
23:48:17.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.724470  7017 heartbeater.cc:461] Registering TS with master...
23:48:17.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.726064  7017 heartbeater.cc:507] Master 127.6.114.125:39367 requested a full tablet report, sending...
23:48:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.726997  7015 heartbeater.cc:344] Connected to a master server at 127.6.114.124:34801
23:48:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.727171  7015 heartbeater.cc:461] Registering TS with master...
23:48:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.727759  7015 heartbeater.cc:507] Master 127.6.114.124:34801 requested a full tablet report, sending...
23:48:17.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.729725  6718 ts_manager.cc:194] Registered new tserver with Master: 1228d72bb77941ef982d60ce38a833cf (127.6.114.65:39287)
23:48:17.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.732268  6790 ts_manager.cc:194] Registered new tserver with Master: 1228d72bb77941ef982d60ce38a833cf (127.6.114.65:39287)
23:48:17.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.734194  6790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.114.65:48563
23:48:17.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.734954  7016 heartbeater.cc:344] Connected to a master server at 127.6.114.126:40573
23:48:17.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.735142  7016 heartbeater.cc:461] Registering TS with master...
23:48:17.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.735786  7016 heartbeater.cc:507] Master 127.6.114.126:40573 requested a full tablet report, sending...
23:48:17.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.737820  6644 ts_manager.cc:194] Registered new tserver with Master: 1228d72bb77941ef982d60ce38a833cf (127.6.114.65:39287)
23:48:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.783572  6877 catalog_manager.cc:1294] Loaded cluster ID: 7a9858c18b2841f39becbd60318d2045
23:48:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.783746  6877 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: loading cluster ID for follower catalog manager: success
23:48:17.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.787926  6877 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: acquiring CA information for follower catalog manager: success
23:48:17.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:17.790838  6877 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f92f47c51b7447558a0b791af3270a64: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:18.038 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:18.039 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:18.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:18.040 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:18.040 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:18.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:18.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:18.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:18.041 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:18.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:18.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:18.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:18.043 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:18.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468098091 for job 6446e0085b210020482ce7a622d23630.
23:48:18.111 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
23:48:18.113 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
23:48:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.129144  7023 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.129719  7023 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.129886  7023 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:18.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.139549  7023 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:18.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.140015  7023 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.114.66
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.151922  7023 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.66:0
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data/info.pb
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.66
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.114.66
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/logs
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:18.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.153771  7023 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:18.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.156085  7023 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:18.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.166929  7031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:18.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468098167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:18.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.166945  7032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:18.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.172013  7034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.173638  7023 server_base.cc:1061] running on GCE node
23:48:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.174525  7023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:18.177 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:18.179 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
23:48:18.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.183238  7023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.184710  7023 hybrid_clock.cc:648] HybridClock initialized: now 1783468098184591 us; error 113 us; skew 500 ppm
23:48:18.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.185256  7023 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:18.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.188076  7023 webserver.cc:534] Webserver started at http://127.6.114.66:34679/ using document root <none> and password file <none>
23:48:18.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.188896  7023 fs_manager.cc:362] Metadata directory not provided
23:48:18.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.189038  7023 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:18.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.189432  7023 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:18.190 [DEBUG - pool-18-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.2.216.126:46485, [14ms] received response from server master-127.2.216.126:46485: OK, deferred=null) with no deferred attached!
23:48:18.191 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.2.216.126:46485, [7ms] received response from server master-127.2.216.126:46485: OK, deferred=null) with no deferred attached!
23:48:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.192247  7023 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data/instance:
23:48:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8a7b3dfc53cd4620bf89732518171bde"
23:48:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:18 on dist-test-slave-hfsf"
23:48:18.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.193369  7023 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal/instance:
23:48:18.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8a7b3dfc53cd4620bf89732518171bde"
23:48:18.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:18 on dist-test-slave-hfsf"
23:48:18.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.199783  7023 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:48:18.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.204084  7040 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:18.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.205654  7023 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.205821  7023 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8a7b3dfc53cd4620bf89732518171bde"
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:18 on dist-test-slave-hfsf"
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.206073  7023 fs_report.cc:389] FS layout report
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data/data
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:18.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.220228  7023 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:18.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.221084  7023 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:18.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.221400  7023 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:18.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.222561  7023 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.224665  7023 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.224758  7023 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.224862  7023 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:18.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.224936  7023 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:18.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.285678  7023 rpc_server.cc:307] RPC server started. Bound to: 127.6.114.66:44747
23:48:18.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.285778  7152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.114.66:44747 every 8 connection(s)
23:48:18.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.287595  7023 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/data/info.pb
23:48:18.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.295971  6601 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 7023
23:48:18.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.296236  6601 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-1/wal/instance
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.305747  6601 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/logs
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data/info.pb
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.67:0
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.114.67
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.67
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:18.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:18.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.332875  7155 heartbeater.cc:344] Connected to a master server at 127.6.114.125:39367
23:48:18.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.333374  7155 heartbeater.cc:461] Registering TS with master...
23:48:18.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.334703  7155 heartbeater.cc:507] Master 127.6.114.125:39367 requested a full tablet report, sending...
23:48:18.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.335866  7153 heartbeater.cc:344] Connected to a master server at 127.6.114.124:34801
23:48:18.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.336023  7153 heartbeater.cc:461] Registering TS with master...
23:48:18.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.336630  7153 heartbeater.cc:507] Master 127.6.114.124:34801 requested a full tablet report, sending...
23:48:18.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.337071  6718 ts_manager.cc:194] Registered new tserver with Master: 8a7b3dfc53cd4620bf89732518171bde (127.6.114.66:44747)
23:48:18.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.338335  7154 heartbeater.cc:344] Connected to a master server at 127.6.114.126:40573
23:48:18.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.338488  7154 heartbeater.cc:461] Registering TS with master...
23:48:18.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.338992  6790 ts_manager.cc:194] Registered new tserver with Master: 8a7b3dfc53cd4620bf89732518171bde (127.6.114.66:44747)
23:48:18.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.339125  7154 heartbeater.cc:507] Master 127.6.114.126:40573 requested a full tablet report, sending...
23:48:18.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.340167  6790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.114.66:50973
23:48:18.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.341362  6644 ts_manager.cc:194] Registered new tserver with Master: 8a7b3dfc53cd4620bf89732518171bde (127.6.114.66:44747)
23:48:18.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468098591 for job 6446e0085b210020482ce7a622d23630.
23:48:18.602 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:18.602 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
23:48:18.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468098667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:18.677 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:18.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
23:48:18.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.736945  7163 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:18.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.737365  7163 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:18.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.737475  7163 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.738670  7015 heartbeater.cc:499] Master 127.6.114.124:34801 was elected leader, sending a full tablet report...
23:48:18.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.748739  7163 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:18.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.749148  7163 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.114.67
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.762516  7163 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.114.84:46067
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.114.67:0
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data/info.pb
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.114.67
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.114.126:40573,127.6.114.125:39367,127.6.114.124:34801
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.114.67
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/logs
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:18.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.764528  7163 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:18.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.766669  7163 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:18.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.779912  7172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:18.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.780002  7169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:18.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.780120  7170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:18.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.781360  7163 server_base.cc:1061] running on GCE node
23:48:18.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.782016  7163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:18.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.783205  7163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:18.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.784476  7163 hybrid_clock.cc:648] HybridClock initialized: now 1783468098784429 us; error 30 us; skew 500 ppm
23:48:18.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.785017  7163 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.788091  7163 webserver.cc:534] Webserver started at http://127.6.114.67:38709/ using document root <none> and password file <none>
23:48:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.789211  7163 fs_manager.cc:362] Metadata directory not provided
23:48:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.789376  7163 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.789819  7163 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.793063  7163 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data/instance:
23:48:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "efec05789b2e4188af7d674a2631288c"
23:48:18.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:18 on dist-test-slave-hfsf"
23:48:18.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.794157  7163 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal/instance:
23:48:18.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "efec05789b2e4188af7d674a2631288c"
23:48:18.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:18 on dist-test-slave-hfsf"
23:48:18.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.801172  7163 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
23:48:18.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.805922  7178 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.807824  7163 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.808079  7163 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "efec05789b2e4188af7d674a2631288c"
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:18 on dist-test-slave-hfsf"
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.808355  7163 fs_report.cc:389] FS layout report
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data/data
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:18.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.827095  7163 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:18.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.828132  7163 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:18.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.828469  7163 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:18.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.829564  7163 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:18.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.831651  7163 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:18.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.831943  7163 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
23:48:18.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.832175  7163 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:18.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.832294  7163 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:18.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.874663  7163 rpc_server.cc:307] RPC server started. Bound to: 127.6.114.67:35947
23:48:18.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.874709  7290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.114.67:35947 every 8 connection(s)
23:48:18.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.876560  7163 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/data/info.pb
23:48:18.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.879200  6601 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 7163
23:48:18.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.879407  6601 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16403511712816405783/ts-2/wal/instance
23:48:18.898 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:18.898 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:18.899 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:18.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:18.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:18.900 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:18.901 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:18.901 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:18.901 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:18.901 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:18.901 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:18.901 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:18.902 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:18.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.913511  7294 heartbeater.cc:344] Connected to a master server at 127.6.114.125:39367
23:48:18.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.913965  7294 heartbeater.cc:461] Registering TS with master...
23:48:18.915 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [3ms] received response from server master-127.2.42.124:36407: OK, deferred=null) with no deferred attached!
23:48:18.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.915709  7292 heartbeater.cc:344] Connected to a master server at 127.6.114.124:34801
23:48:18.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.915838  7292 heartbeater.cc:461] Registering TS with master...
23:48:18.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.915300  7294 heartbeater.cc:507] Master 127.6.114.125:39367 requested a full tablet report, sending...
23:48:18.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.916363  7292 heartbeater.cc:507] Master 127.6.114.124:34801 requested a full tablet report, sending...
23:48:18.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.917210  7293 heartbeater.cc:344] Connected to a master server at 127.6.114.126:40573
23:48:18.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.917351  7293 heartbeater.cc:461] Registering TS with master...
23:48:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.917685  6790 ts_manager.cc:194] Registered new tserver with Master: efec05789b2e4188af7d674a2631288c (127.6.114.67:35947)
23:48:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.917850  7293 heartbeater.cc:507] Master 127.6.114.126:40573 requested a full tablet report, sending...
23:48:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.918747  6790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.114.67:54291
23:48:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.919514  6644 ts_manager.cc:194] Registered new tserver with Master: efec05789b2e4188af7d674a2631288c (127.6.114.67:35947)
23:48:18.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.919951  6718 ts_manager.cc:194] Registered new tserver with Master: efec05789b2e4188af7d674a2631288c (127.6.114.67:35947)
23:48:18.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.924969  6601 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:18.927 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:18.927 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:18.928 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.6.114.126"
      port: 40573
    }
    bound_http_address {
      host: "127.6.114.126"
      port: 35585
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.6.114.125"
      port: 39367
    }
    bound_http_address {
      host: "127.6.114.125"
      port: 36599
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.6.114.124"
      port: 34801
    }
    bound_http_address {
      host: "127.6.114.124"
      port: 35573
    }
  }
}

23:48:18.929 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:18.929 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.6.114.65"
      port: 39287
    }
    bound_http_address {
      host: "127.6.114.65"
      port: 41515
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.6.114.66"
      port: 44747
    }
    bound_http_address {
      host: "127.6.114.66"
      port: 34679
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.6.114.67"
      port: 35947
    }
    bound_http_address {
      host: "127.6.114.67"
      port: 38709
    }
  }
}

23:48:18.930 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:18.931 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:18.933 [DEBUG - main] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:18.934 [DEBUG - main] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:18.934 [DEBUG - main] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:18.934 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.195.124:40929(127.5.195.124:40929)] Successfully connected to peer
23:48:18.936 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.195.126:36941(127.5.195.126:36941)] Successfully connected to peer
23:48:18.937 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.124
23:48:18.937 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.195.125:41211(127.5.195.125:41211)] Successfully connected to peer
23:48:18.939 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.125
23:48:18.946 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.126
23:48:18.950 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:18.954 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x683e9880, L:/127.0.0.1:56136 - R:/127.5.195.124:40929] using SASL/PLAIN
23:48:18.957 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:18.958 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=25), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [25ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: OK, deferred=null) after lookup
23:48:18.961 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:18.963 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:18.959882  6087 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56136:
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:18.964 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf34c26a8, L:/127.0.0.1:51910 - R:/127.5.195.126:36941] using SASL/PLAIN
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:18.961908  6087 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:18.967 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x76afaac0, L:/127.0.0.1:38666 - R:/127.5.195.125:41211] using SASL/PLAIN
23:48:19.008 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:19.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.053354  6250 tablet_service.cc:1511] Processing CreateTablet for tablet 0581a9cc392a4c22bd5d60a253a247a9 (DEFAULT_TABLE table=replication_test_table [id=c79cdb724e40418d83a1ef8c16fc7ba7]), partition=
23:48:19.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.055369  6250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0581a9cc392a4c22bd5d60a253a247a9. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:19.061 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:19.062 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:19.062 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:19.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:19.063 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:19.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:19.063 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:19.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:19.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:19.064 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:19.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:19.064 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:19.064 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:19.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.061297  6389 tablet_service.cc:1511] Processing CreateTablet for tablet 0581a9cc392a4c22bd5d60a253a247a9 (DEFAULT_TABLE table=replication_test_table [id=c79cdb724e40418d83a1ef8c16fc7ba7]), partition=
23:48:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.065588  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0581a9cc392a4c22bd5d60a253a247a9. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.069067  6526 tablet_service.cc:1511] Processing CreateTablet for tablet 0581a9cc392a4c22bd5d60a253a247a9 (DEFAULT_TABLE table=replication_test_table [id=c79cdb724e40418d83a1ef8c16fc7ba7]), partition=
23:48:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.070541  6526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0581a9cc392a4c22bd5d60a253a247a9. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:19.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468099091 for job 6446e0085b210020482ce7a622d23630.
23:48:19.107 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:19.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.106952  7329 tablet_bootstrap.cc:492] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: Bootstrap starting.
23:48:19.109 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
23:48:19.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.112819  7329 tablet_bootstrap.cc:654] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: Neither blocks nor log segments found. Creating new log.
23:48:19.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.114684  7329 log.cc:826] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: Log is configured to *not* fsync() on all Append() calls
23:48:19.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.120879  7330 tablet_bootstrap.cc:492] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: Bootstrap starting.
23:48:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.123701  7331 tablet_bootstrap.cc:492] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: Bootstrap starting.
23:48:19.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.134501  7330 tablet_bootstrap.cc:654] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: Neither blocks nor log segments found. Creating new log.
23:48:19.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.136153  7331 tablet_bootstrap.cc:654] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: Neither blocks nor log segments found. Creating new log.
23:48:19.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.137918  7330 log.cc:826] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: Log is configured to *not* fsync() on all Append() calls
23:48:19.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.139635  7331 log.cc:826] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: Log is configured to *not* fsync() on all Append() calls
23:48:19.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.144284  7329 tablet_bootstrap.cc:492] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: No bootstrap required, opened a new log
23:48:19.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.144862  7329 ts_tablet_manager.cc:1403] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.010s
23:48:19.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.153204  7329 raft_consensus.cc:359] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.153949  7329 raft_consensus.cc:385] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:19.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.154289  7329 raft_consensus.cc:740] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3f013f8ac664ac0b15edcdaed3bc059, State: Initialized, Role: FOLLOWER
23:48:19.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.154644  7330 tablet_bootstrap.cc:492] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: No bootstrap required, opened a new log
23:48:19.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.155186  7330 ts_tablet_manager.cc:1403] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.014s
23:48:19.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.155807  7329 consensus_queue.cc:260] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.157529  7331 tablet_bootstrap.cc:492] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: No bootstrap required, opened a new log
23:48:19.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.158067  7331 ts_tablet_manager.cc:1403] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.011s
23:48:19.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.164108  7330 raft_consensus.cc:359] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.164664  7330 raft_consensus.cc:385] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:19.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.164785  7330 raft_consensus.cc:740] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3efe4d45f9194c6d8686d03b8f5ee41f, State: Initialized, Role: FOLLOWER
23:48:19.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.165848  7330 consensus_queue.cc:260] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468099167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:19.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.170346  7329 ts_tablet_manager.cc:1434] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.008s
23:48:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.181656  7330 ts_tablet_manager.cc:1434] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.009s
23:48:19.186 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
23:48:19.188 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
23:48:19.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.188356  6461 tablet.cc:2406] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:19.193 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:19.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:19.194 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:19.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:19.194 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:19.194 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:19.194 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:19.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:19.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:19.195 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:19.195 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:19.195 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:19.195 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.198136  7331 raft_consensus.cc:359] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.198683  7331 raft_consensus.cc:385] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.198828  7331 raft_consensus.cc:740] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3fde060d3504b499957cf300a35fe9d, State: Initialized, Role: FOLLOWER
23:48:19.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.199600  7331 consensus_queue.cc:260] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.201611  7331 ts_tablet_manager.cc:1434] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: Time spent starting tablet: real 0.043s	user 0.012s	sys 0.001s
23:48:19.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.240660  7335 raft_consensus.cc:493] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:19.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.241044  7335 raft_consensus.cc:515] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.243394  7335 leader_election.cc:290] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3efe4d45f9194c6d8686d03b8f5ee41f (127.5.195.65:44721), f3fde060d3504b499957cf300a35fe9d (127.5.195.67:33791)
23:48:19.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.270459  6270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0581a9cc392a4c22bd5d60a253a247a9" candidate_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" is_pre_election: true
23:48:19.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.271108  6270 raft_consensus.cc:2468] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f013f8ac664ac0b15edcdaed3bc059 in term 0.
23:48:19.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.272010  6342 leader_election.cc:304] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3efe4d45f9194c6d8686d03b8f5ee41f, c3f013f8ac664ac0b15edcdaed3bc059; no voters: 
23:48:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.273036  7335 raft_consensus.cc:2804] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.273193  7335 raft_consensus.cc:493] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.273306  7335 raft_consensus.cc:3060] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 0 FOLLOWER]: Advancing to term 1
23:48:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.273566  6546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0581a9cc392a4c22bd5d60a253a247a9" candidate_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3fde060d3504b499957cf300a35fe9d" is_pre_election: true
23:48:19.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.274139  6546 raft_consensus.cc:2468] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3f013f8ac664ac0b15edcdaed3bc059 in term 0.
23:48:19.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.276317  7335 raft_consensus.cc:515] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.277022  7335 leader_election.cc:290] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [CANDIDATE]: Term 1 election: Requested vote from peers 3efe4d45f9194c6d8686d03b8f5ee41f (127.5.195.65:44721), f3fde060d3504b499957cf300a35fe9d (127.5.195.67:33791)
23:48:19.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.277513  6270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0581a9cc392a4c22bd5d60a253a247a9" candidate_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f"
23:48:19.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.277743  6270 raft_consensus.cc:3060] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 0 FOLLOWER]: Advancing to term 1
23:48:19.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.277819  6546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0581a9cc392a4c22bd5d60a253a247a9" candidate_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3fde060d3504b499957cf300a35fe9d"
23:48:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.278012  6546 raft_consensus.cc:3060] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 0 FOLLOWER]: Advancing to term 1
23:48:19.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.280407  6270 raft_consensus.cc:2468] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f013f8ac664ac0b15edcdaed3bc059 in term 1.
23:48:19.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.280941  6342 leader_election.cc:304] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3efe4d45f9194c6d8686d03b8f5ee41f, c3f013f8ac664ac0b15edcdaed3bc059; no voters: 
23:48:19.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.281322  7335 raft_consensus.cc:2804] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 1 FOLLOWER]: Leader election won for term 1
23:48:19.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.281734  6546 raft_consensus.cc:2468] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3f013f8ac664ac0b15edcdaed3bc059 in term 1.
23:48:19.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.281950  7335 raft_consensus.cc:697] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [term 1 LEADER]: Becoming Leader. State: Replica: c3f013f8ac664ac0b15edcdaed3bc059, State: Running, Role: LEADER
23:48:19.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.282582  7335 consensus_queue.cc:237] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } }
23:48:19.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.287670  6598 tablet.cc:2406] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:19.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.291252  6320 tablet.cc:2406] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:19.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.295078  6087 catalog_manager.cc:5696] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3f013f8ac664ac0b15edcdaed3bc059 (127.5.195.66). New cstate: current_term: 1 leader_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3f013f8ac664ac0b15edcdaed3bc059" member_type: VOTER last_known_addr { host: "127.5.195.66" port: 38627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 } health_report { overall_health: UNKNOWN } } }
23:48:19.318 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:19.322 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0581a9cc392a4c22bd5d60a253a247a9 for table 'replication_test_table' with partition [<start>, <end>)
23:48:19.322 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0581a9cc392a4c22bd5d60a253a247a9@[3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721),c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)[L],f3fde060d3504b499957cf300a35fe9d(127.5.195.67:33791)]}]
23:48:19.322 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.5.195.124:40929, [3ms] Sub RPC GetTableLocations: received response from server master-127.5.195.124:40929: OK, deferred=null) after lookup
23:48:19.323 [DEBUG - kudu-nio-0] (Connection.java:748) [peer c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)] connecting to peer
23:48:19.324 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)] Successfully connected to peer
23:48:19.336 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.340 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x751ebfd2, L:/127.0.0.1:48616 - R:/127.5.195.66:38627] using TOKEN/null
23:48:19.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.343115  7153 heartbeater.cc:499] Master 127.6.114.124:34801 was elected leader, sending a full tablet report...
23:48:19.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.351492  6270 raft_consensus.cc:1275] T 0581a9cc392a4c22bd5d60a253a247a9 P 3efe4d45f9194c6d8686d03b8f5ee41f [term 1 FOLLOWER]: Refusing update from remote peer c3f013f8ac664ac0b15edcdaed3bc059: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:19.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.351548  6546 raft_consensus.cc:1275] T 0581a9cc392a4c22bd5d60a253a247a9 P f3fde060d3504b499957cf300a35fe9d [term 1 FOLLOWER]: Refusing update from remote peer c3f013f8ac664ac0b15edcdaed3bc059: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:19.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.352903  7340 consensus_queue.cc:1048] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3efe4d45f9194c6d8686d03b8f5ee41f" member_type: VOTER last_known_addr { host: "127.5.195.65" port: 44721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:19.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.353250  7335 consensus_queue.cc:1048] T 0581a9cc392a4c22bd5d60a253a247a9 P c3f013f8ac664ac0b15edcdaed3bc059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3fde060d3504b499957cf300a35fe9d" member_type: VOTER last_known_addr { host: "127.5.195.67" port: 33791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:19.358 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:19.359 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:19.359 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:19.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:19.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:19.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:19.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:19.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:19.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:19.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:19.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:19.363 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:19.363 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:19.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.377688  7345 mvcc.cc:204] Tried to move back new op lower bound from 7305085334931578880 to 7305085334667325440. Current Snapshot: MvccSnapshot[applied={T|T < 7305085334931578880}]
23:48:19.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.389675  7344 mvcc.cc:204] Tried to move back new op lower bound from 7305085334931578880 to 7305085334667325440. Current Snapshot: MvccSnapshot[applied={T|T < 7305085334931578880}]
23:48:19.475 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:19.477 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:19.478 [DEBUG - main] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:19.482 [DEBUG - main] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:19.483 [DEBUG - main] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:19.484 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.114.126:40573(127.6.114.126:40573)] Successfully connected to peer
23:48:19.486 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.114.124:34801(127.6.114.124:34801)] Successfully connected to peer
23:48:19.489 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.114.125:39367(127.6.114.125:39367)] Successfully connected to peer
23:48:19.496 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.125
23:48:19.496 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.126
23:48:19.507 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.510 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.511 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9ed5bb35, L:/127.0.0.1:43446 - R:/127.6.114.126:40573] using SASL/PLAIN
23:48:19.512 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.124
23:48:19.513 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa9139d27, L:/127.0.0.1:57852 - R:/127.6.114.125:39367] using SASL/PLAIN
23:48:19.522 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.526 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x087151e6, L:/127.0.0.1:52154 - R:/127.6.114.124:34801] using SASL/PLAIN
23:48:19.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:19.529 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=51), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [36ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: OK, [50ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: OK, deferred=null) after lookup
23:48:19.532 [DEBUG - main] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:19.533 [DEBUG - main] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:19.534 [DEBUG - main] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:19.534 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.195.124:40929(127.5.195.124:40929)] Successfully connected to peer
23:48:19.536 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.195.126:36941(127.5.195.126:36941)] Successfully connected to peer
23:48:19.537 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.195.125:41211(127.5.195.125:41211)] Successfully connected to peer
23:48:19.548 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.126
23:48:19.553 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.125
23:48:19.555 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.124
23:48:19.564 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.568 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.572 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:19.573 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xddb7449c, L:/127.0.0.1:38674 - R:/127.5.195.125:41211] using SASL/PLAIN
23:48:19.577 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb35a9c5f, L:/127.0.0.1:56140 - R:/127.5.195.124:40929] using SASL/PLAIN
23:48:19.577 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xeba52697, L:/127.0.0.1:51914 - R:/127.5.195.126:36941] using SASL/PLAIN
23:48:19.582 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:19.582 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=50), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [44ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: OK, deferred=null) after lookup
23:48:19.584 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:19.587 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0581a9cc392a4c22bd5d60a253a247a9 for table 'replication_test_table' with partition [<start>, <end>)
23:48:19.587 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0581a9cc392a4c22bd5d60a253a247a9@[3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721),c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)[L],f3fde060d3504b499957cf300a35fe9d(127.5.195.67:33791)]}]
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.590132  6790 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52154:
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:48:19.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468099591 for job 6446e0085b210020482ce7a622d23630.
23:48:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.592629  6790 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:19.604 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
23:48:19.605 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
23:48:19.626 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:19.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468099667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:19.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.681243  7226 tablet_service.cc:1511] Processing CreateTablet for tablet df3ef3833d2d406e96c8218627391e44 (DEFAULT_TABLE table=replication_test_table [id=4facac77cd1745f1973066e613204f01]), partition=
23:48:19.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.682554  7226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3ef3833d2d406e96c8218627391e44. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:19.683 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:19.685 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
23:48:19.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.682981  6950 tablet_service.cc:1511] Processing CreateTablet for tablet df3ef3833d2d406e96c8218627391e44 (DEFAULT_TABLE table=replication_test_table [id=4facac77cd1745f1973066e613204f01]), partition=
23:48:19.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.684075  6950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3ef3833d2d406e96c8218627391e44. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:19.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.696599  7088 tablet_service.cc:1511] Processing CreateTablet for tablet df3ef3833d2d406e96c8218627391e44 (DEFAULT_TABLE table=replication_test_table [id=4facac77cd1745f1973066e613204f01]), partition=
23:48:19.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.698141  7088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3ef3833d2d406e96c8218627391e44. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:19.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.722925  7384 tablet_bootstrap.cc:492] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: Bootstrap starting.
23:48:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.727763  7385 tablet_bootstrap.cc:492] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: Bootstrap starting.
23:48:19.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.730202  7386 tablet_bootstrap.cc:492] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: Bootstrap starting.
23:48:19.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.732133  7384 tablet_bootstrap.cc:654] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: Neither blocks nor log segments found. Creating new log.
23:48:19.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.734220  7386 tablet_bootstrap.cc:654] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: Neither blocks nor log segments found. Creating new log.
23:48:19.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.735895  7384 log.cc:826] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: Log is configured to *not* fsync() on all Append() calls
23:48:19.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.737696  7385 tablet_bootstrap.cc:654] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: Neither blocks nor log segments found. Creating new log.
23:48:19.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.739624  7385 log.cc:826] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: Log is configured to *not* fsync() on all Append() calls
23:48:19.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.744990  7385 tablet_bootstrap.cc:492] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: No bootstrap required, opened a new log
23:48:19.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.745345  7385 ts_tablet_manager.cc:1403] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: Time spent bootstrapping tablet: real 0.018s	user 0.002s	sys 0.005s
23:48:19.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.745751  7384 tablet_bootstrap.cc:492] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: No bootstrap required, opened a new log
23:48:19.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.746070  7384 ts_tablet_manager.cc:1403] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
23:48:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.747026  7386 log.cc:826] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: Log is configured to *not* fsync() on all Append() calls
23:48:19.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.753930  7384 raft_consensus.cc:359] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.754487  7384 raft_consensus.cc:385] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:19.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.754595  7384 raft_consensus.cc:740] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1228d72bb77941ef982d60ce38a833cf, State: Initialized, Role: FOLLOWER
23:48:19.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.754899  7385 raft_consensus.cc:359] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.755424  7385 raft_consensus.cc:385] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:19.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.755558  7385 raft_consensus.cc:740] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7b3dfc53cd4620bf89732518171bde, State: Initialized, Role: FOLLOWER
23:48:19.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.755570  7384 consensus_queue.cc:260] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.756242  7385 consensus_queue.cc:260] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.758483  7386 tablet_bootstrap.cc:492] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: No bootstrap required, opened a new log
23:48:19.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.759601  7386 ts_tablet_manager.cc:1403] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
23:48:19.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.769809  7384 ts_tablet_manager.cc:1434] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: Time spent starting tablet: real 0.024s	user 0.015s	sys 0.009s
23:48:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.774910  7385 ts_tablet_manager.cc:1434] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: Time spent starting tablet: real 0.029s	user 0.016s	sys 0.015s
23:48:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.778255  7386 raft_consensus.cc:359] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.778978  7386 raft_consensus.cc:385] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.779112  7386 raft_consensus.cc:740] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efec05789b2e4188af7d674a2631288c, State: Initialized, Role: FOLLOWER
23:48:19.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.779983  7386 consensus_queue.cc:260] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.782065  7292 heartbeater.cc:499] Master 127.6.114.124:34801 was elected leader, sending a full tablet report...
23:48:19.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.782992  7386 ts_tablet_manager.cc:1434] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: Time spent starting tablet: real 0.023s	user 0.015s	sys 0.002s
23:48:19.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.784978  7392 raft_consensus.cc:493] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:19.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.785457  7392 raft_consensus.cc:515] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.788235  7392 leader_election.cc:290] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a7b3dfc53cd4620bf89732518171bde (127.6.114.66:44747), efec05789b2e4188af7d674a2631288c (127.6.114.67:35947)
23:48:19.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.797567  7108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3ef3833d2d406e96c8218627391e44" candidate_uuid: "1228d72bb77941ef982d60ce38a833cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7b3dfc53cd4620bf89732518171bde" is_pre_election: true
23:48:19.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.797657  7246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3ef3833d2d406e96c8218627391e44" candidate_uuid: "1228d72bb77941ef982d60ce38a833cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efec05789b2e4188af7d674a2631288c" is_pre_election: true
23:48:19.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.798099  7108 raft_consensus.cc:2468] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1228d72bb77941ef982d60ce38a833cf in term 0.
23:48:19.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.798211  7246 raft_consensus.cc:2468] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1228d72bb77941ef982d60ce38a833cf in term 0.
23:48:19.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.798930  6906 leader_election.cc:304] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1228d72bb77941ef982d60ce38a833cf, 8a7b3dfc53cd4620bf89732518171bde; no voters: 
23:48:19.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.799368  7392 raft_consensus.cc:2804] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:19.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.799654  7392 raft_consensus.cc:493] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:19.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.799784  7392 raft_consensus.cc:3060] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 0 FOLLOWER]: Advancing to term 1
23:48:19.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.802693  7392 raft_consensus.cc:515] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.803610  7392 leader_election.cc:290] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [CANDIDATE]: Term 1 election: Requested vote from peers 8a7b3dfc53cd4620bf89732518171bde (127.6.114.66:44747), efec05789b2e4188af7d674a2631288c (127.6.114.67:35947)
23:48:19.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.804080  7108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3ef3833d2d406e96c8218627391e44" candidate_uuid: "1228d72bb77941ef982d60ce38a833cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7b3dfc53cd4620bf89732518171bde"
23:48:19.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.804276  7108 raft_consensus.cc:3060] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [term 0 FOLLOWER]: Advancing to term 1
23:48:19.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.804375  7246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3ef3833d2d406e96c8218627391e44" candidate_uuid: "1228d72bb77941ef982d60ce38a833cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efec05789b2e4188af7d674a2631288c"
23:48:19.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.804658  7246 raft_consensus.cc:3060] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [term 0 FOLLOWER]: Advancing to term 1
23:48:19.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.806555  7108 raft_consensus.cc:2468] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1228d72bb77941ef982d60ce38a833cf in term 1.
23:48:19.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.807060  6906 leader_election.cc:304] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1228d72bb77941ef982d60ce38a833cf, 8a7b3dfc53cd4620bf89732518171bde; no voters: 
23:48:19.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.807407  7392 raft_consensus.cc:2804] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 1 FOLLOWER]: Leader election won for term 1
23:48:19.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.807614  7392 raft_consensus.cc:697] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [term 1 LEADER]: Becoming Leader. State: Replica: 1228d72bb77941ef982d60ce38a833cf, State: Running, Role: LEADER
23:48:19.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.808178  7246 raft_consensus.cc:2468] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1228d72bb77941ef982d60ce38a833cf in term 1.
23:48:19.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.808368  7392 consensus_queue.cc:237] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } }
23:48:19.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:19.815353  6789 catalog_manager.cc:5696] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 1228d72bb77941ef982d60ce38a833cf (127.6.114.65). New cstate: current_term: 1 leader_uuid: "1228d72bb77941ef982d60ce38a833cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1228d72bb77941ef982d60ce38a833cf" member_type: VOTER last_known_addr { host: "127.6.114.65" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 } health_report { overall_health: UNKNOWN } } }
23:48:19.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.817541  7156 tablet.cc:2406] T df3ef3833d2d406e96c8218627391e44 P 8a7b3dfc53cd4620bf89732518171bde: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:19.881 [DEBUG - main] (Connection.java:575) [peer master-127.5.195.124:40929(127.5.195.124:40929)] disconnecting while in state READY
23:48:19.881 [DEBUG - main] (Connection.java:575) [peer master-127.5.195.126:36941(127.5.195.126:36941)] disconnecting while in state READY
23:48:19.881 [DEBUG - main] (Connection.java:575) [peer master-127.5.195.125:41211(127.5.195.125:41211)] disconnecting while in state READY
23:48:19.882 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.195.125:41211(127.5.195.125:41211)] handling channelInactive
23:48:19.882 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.195.126:36941(127.5.195.126:36941)] handling channelInactive
23:48:19.883 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state READY due to: connection closed
23:48:19.883 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state READY due to: connection closed
23:48:19.883 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:19.884 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:19.884 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
23:48:19.888 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.195.124:40929(127.5.195.124:40929)] handling channelInactive
23:48:19.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state READY due to: connection closed
23:48:19.888 [DEBUG - main] (Connection.java:575) [peer master-127.6.114.125:39367(127.6.114.125:39367)] disconnecting while in state READY
23:48:19.888 [DEBUG - main] (Connection.java:575) [peer master-127.6.114.124:34801(127.6.114.124:34801)] disconnecting while in state READY
23:48:19.888 [DEBUG - main] (Connection.java:575) [peer master-127.6.114.126:40573(127.6.114.126:40573)] disconnecting while in state READY
23:48:19.889 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
23:48:19.889 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.114.125:39367(127.6.114.125:39367)] handling channelInactive
23:48:19.889 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.114.124:34801(127.6.114.124:34801)] handling channelInactive
23:48:19.889 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state READY due to: connection closed
23:48:19.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state READY due to: connection closed
23:48:19.889 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:19.891 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:48:19.891 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
23:48:19.894 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.114.126:40573(127.6.114.126:40573)] handling channelInactive
23:48:19.894 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state READY due to: connection closed
23:48:19.894 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
23:48:19.897 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:19.898 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:48:19.898 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:48:19.898 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:19.898 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:19.898 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:19.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.897742  7295 tablet.cc:2406] T df3ef3833d2d406e96c8218627391e44 P efec05789b2e4188af7d674a2631288c: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:19.906 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:48:19.906 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:19.906 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:19.906 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:48:19.906 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:48:19.906 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:48:19.906 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:48:19.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:19.945334  7018 tablet.cc:2406] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:20.108 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468100107 for job 6446e0085b210020482ce7a622d23630.
23:48:20.121 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:48:20.124 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:48:20.126 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
23:48:20.139 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:20.139 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:20.139 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:20.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.142 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.142 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.143 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:20.168 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468100167 for job bbc34d76ac15add629743db00c4f4a33.
23:48:20.179 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:20.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
23:48:20.207 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:48:20.207 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:48:20.208 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:48:20.222 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:20.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:20.257390  7392 consensus_queue.cc:1048] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "efec05789b2e4188af7d674a2631288c" member_type: VOTER last_known_addr { host: "127.6.114.67" port: 35947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:20.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:20.286559  7392 consensus_queue.cc:1048] T df3ef3833d2d406e96c8218627391e44 P 1228d72bb77941ef982d60ce38a833cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7b3dfc53cd4620bf89732518171bde" member_type: VOTER last_known_addr { host: "127.6.114.66" port: 44747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:20.514 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:20.514 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:20.514 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:20.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.516 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.516 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.516 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.516 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:20.594 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468100593 for job 6446e0085b210020482ce7a622d23630.
23:48:20.606 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:48:20.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
23:48:20.668 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468100667 for job bbc34d76ac15add629743db00c4f4a33.
23:48:20.679 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job bbc34d76ac15add629743db00c4f4a33 (1608 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:20.681 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
23:48:20.778 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.126:45489(127.2.42.126:45489)] connecting to peer
23:48:20.778 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.125:42983(127.2.42.125:42983)] connecting to peer
23:48:20.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:20.779 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.2.42.124:36407(127.2.42.124:36407)] connecting to peer
23:48:20.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.42.126:45489(127.2.42.126:45489)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:20.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.126:45489: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489
23:48:20.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:20.780 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.42.125:42983(127.2.42.125:42983)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:20.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:20.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.42.124:36407(127.2.42.124:36407)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:20.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.125:42983: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983
23:48:20.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.42.124:36407: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
23:48:20.780 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407; will retry
23:48:20.782 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28719, elapsed=28582), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [2ms] received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [26ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [144ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [144ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [223ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [224ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [225ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [283ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [285ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [603ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [603ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1560ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1563ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3143ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [5242ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [5245ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [6640ms] refreshing cache from master, [6641ms] too many traces: truncated at 100 traces, deferred=Deferred@669837593(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933)))
23:48:20.783 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=37568e9b29014c3e9276b04109023ab5, attempt=12, KuduRpc(method=Scan, tablet=37568e9b29014c3e9276b04109023ab5, attempt=12, TimeoutTracker(timeout=30000, elapsed=29865), Traces: [0ms] sending RPC to server b12f0866b0104f9ebf76bdc0cd56d7e9, [425ms] received response from server b12f0866b0104f9ebf76bdc0cd56d7e9: Network error: connection closed, [426ms] delaying RPC due to: Network error: connection closed, [441ms] sending RPC to server 5166c0ced7204d998d8062d51526bfbd, [445ms] received response from server 5166c0ced7204d998d8062d51526bfbd: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [445ms] delaying RPC due to: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [462ms] sending RPC to server 7a910d7b024e4df2993580f4f2923bb5, [663ms] received response from server 7a910d7b024e4df2993580f4f2923bb5: Network error: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367], [663ms] delaying RPC due to: Network error: [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] unexpected exception from downstream on [id: 0xe9828026, L:/127.0.0.1:56250 - R:/127.2.42.67:34367], [681ms] refreshing cache from master, [681ms] Sub RPC GetTableLocations: refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [717ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: OK, [726ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: OK, [727ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [730ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, [731ms] sending RPC to server b12f0866b0104f9ebf76bdc0cd56d7e9, [734ms] received response from server b12f0866b0104f9ebf76bdc0cd56d7e9: Network error: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741, [734ms] delaying RPC due to: Network error: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741, [782ms] sending RPC to server 5166c0ced7204d998d8062d51526bfbd, [784ms] received response from server 5166c0ced7204d998d8062d51526bfbd: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [784ms] delaying RPC due to: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [822ms] sending RPC to server 7a910d7b024e4df2993580f4f2923bb5, [824ms] received response from server 7a910d7b024e4df2993580f4f2923bb5: Network error: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367, [824ms] delaying RPC due to: Network error: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367, [861ms] refreshing cache from master, [861ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [864ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: OK, [866ms] sending RPC to server b12f0866b0104f9ebf76bdc0cd56d7e9, [867ms] received response from server b12f0866b0104f9ebf76bdc0cd56d7e9: Network error: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741, [867ms] delaying RPC due to: Network error: Failed to connect to peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741): Connection refused: /127.2.42.66:39741, [941ms] sending RPC to server 5166c0ced7204d998d8062d51526bfbd, [943ms] received response from server 5166c0ced7204d998d8062d51526bfbd: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [943ms] delaying RPC due to: Network error: Failed to connect to peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257): Connection refused: /127.2.42.65:39257, [1221ms] sending RPC to server 7a910d7b024e4df2993580f4f2923bb5, [1223ms] received response from server 7a910d7b024e4df2993580f4f2923bb5: Network error: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367, [1223ms] delaying RPC due to: Network error: Failed to connect to peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367): Connection refused: /127.2.42.67:34367, [1281ms] refreshing cache from master, [1281ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.42.124:36407, [1283ms] Sub RPC GetTableLocations: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1283ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1301ms] Sub RPC GetTableLocations: refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1307ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1321ms] Sub RPC GetTableLocations: refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1324ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1340ms] Sub RPC GetTableLocations: refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1344ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1361ms] Sub RPC GetTableLocations: refreshing cache from master, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1365ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1365ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1401ms] Sub RPC GetTableLocations: refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1404ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1404ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1405ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1421ms] Sub RPC GetTableLocations: refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1425ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1501ms] Sub RPC GetTableLocations: refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1506ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1561ms] Sub RPC GetTableLocations: refreshing cache from master, [1562ms] too many traces: truncated at 100 traces, deferred=Deferred@1598196241(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@566100826 after retry RPC@1479309314) -> (continuation of Deferred@321901942 after retry RPC@788875351), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@566100826 after retry RPC@1479309314) -> (continuation of Deferred@321901942 after retry RPC@788875351)))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28719, elapsed=28582), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [2ms] received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [26ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [144ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [144ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [223ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [224ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [225ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [283ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [285ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [603ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [603ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1560ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1563ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3143ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [5242ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [5245ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [6640ms] refreshing cache from master, [6641ms] too many traces: truncated at 100 traces, deferred=Deferred@669837593(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.42.124:36407
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:20.784 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28719, elapsed=28582), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [2ms] received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [26ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [144ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [144ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [223ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [224ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [225ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [283ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [285ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [603ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [603ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1560ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1563ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3143ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [5242ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [5245ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [6640ms] refreshing cache from master, [6641ms] too many traces: truncated at 100 traces, deferred=Deferred@669837593(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.42.124:36407
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:20.786 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
23:48:20.786 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28719, elapsed=28582), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [2ms] received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [26ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [144ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [144ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [223ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [224ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [225ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [283ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [285ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [603ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [603ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1560ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1563ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3143ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [5242ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [5245ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [6640ms] refreshing cache from master, [6641ms] too many traces: truncated at 100 traces, deferred=Deferred@669837593(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.42.124:36407
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:20.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 7a910d7b024e4df2993580f4f2923bb5(127.2.42.67:34367)] disconnecting while in state TERMINATED
23:48:20.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.42.124:36407(127.2.42.124:36407)] disconnecting while in state TERMINATED
23:48:20.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.42.125:42983(127.2.42.125:42983)] disconnecting while in state TERMINATED
23:48:20.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 5166c0ced7204d998d8062d51526bfbd(127.2.42.65:39257)] disconnecting while in state TERMINATED
23:48:20.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer b12f0866b0104f9ebf76bdc0cd56d7e9(127.2.42.66:39741)] disconnecting while in state TERMINATED
23:48:20.787 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.42.126:45489(127.2.42.126:45489)] disconnecting while in state TERMINATED
23:48:20.789 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:20.790 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.216.126:46485(127.2.216.126:46485)] disconnecting while in state TERMINATED
23:48:20.790 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.216.125:34537(127.2.216.125:34537)] disconnecting while in state TERMINATED
23:48:20.790 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2497782e9f38423697f3ef19daca47ce(127.2.216.65:34053)] disconnecting while in state TERMINATED
23:48:20.790 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.216.124:33041(127.2.216.124:33041)] disconnecting while in state TERMINATED
23:48:20.790 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:20.791 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:20.791 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-3
23:48:20.791 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:48:20.792 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
23:48:20.792 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:20.792 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
23:48:20.792 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:20.792 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 7 thread-local buffer(s) from thread: kudu-nio-2
23:48:20.793 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-4
23:48:20.793 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
23:48:20.794 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:20.796 [WARN - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28719, elapsed=28582), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [2ms] received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [26ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [144ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [144ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [223ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [224ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [225ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [283ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [285ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [603ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [603ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1560ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1563ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3143ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [5242ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [5245ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [6640ms] refreshing cache from master, [6641ms] too many traces: truncated at 100 traces, deferred=Deferred@669837593(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.42.124:36407
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:20.800 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:48:20.822 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:48:20.831 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED on da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28719, elapsed=28582), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [2ms] received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [26ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [144ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [144ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [223ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [224ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [225ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [283ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [285ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [602ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [603ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [603ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1560ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [1563ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [3143ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [3143ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.126:45489, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.125:42983, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.42.124:36407, [5242ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.126:45489: Network error: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.124:36407: Network error: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [5243ms] Sub RPC ConnectToMaster: received response from server master-127.2.42.125:42983: Network error: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983, [5245ms] delaying RPC due to: Service unavailable: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407, [6640ms] refreshing cache from master, [6641ms] too many traces: truncated at 100 traces, deferred=Deferred@669837593(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1745106409 after retry RPC after error@2021282885) -> (continuation of Deferred@1741331340 after retry RPC after error@665719373) -> (continuation of Deferred@1850527788 after retry RPC after error@1144941020) -> (continuation of Deferred@1998294060 after retry RPC after error@552649976) -> (continuation of Deferred@682995066 after retry RPC after error@527585593) -> (continuation of Deferred@883151895 after retry RPC after error@307364223) -> (continuation of Deferred@386506802 after retry RPC after error@452972659) -> (continuation of Deferred@819375191 after retry RPC after error@839719627) -> (continuation of Deferred@1759454344 after retry RPC after error@214371752) -> (continuation of Deferred@158776435 after retry RPC after error@1408709844) -> (continuation of Deferred@1109242182 after retry RPC after error@1979928288) -> (continuation of Deferred@1252716919 after retry RPC after error@546389346) -> (continuation of Deferred@254357431 after retry RPC after error@1664161020) -> (continuation of Deferred@2114810020 after retry RPC after error@1474177066) -> (continuation of Deferred@298643953 after retry RPC after error@2058453440) -> (continuation of Deferred@1865176674 after retry RPC after error@1234549973) -> (continuation of Deferred@1059098479 after retry RPC after error@1231660746) -> (continuation of Deferred@1157330627 after retry RPC after error@543955357) -> (continuation of Deferred@462201096 after retry RPC after error@534186821) -> (continuation of Deferred@338706 after retry RPC after error@1080388222) -> (continuation of Deferred@1050609563 after retry RPC after error@431337006) -> (continuation of Deferred@809589681 after retry RPC after error@1528623453) -> (continuation of Deferred@494503546 after retry RPC after error@696880933)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.42.126:45489,127.2.42.125:42983,127.2.42.124:36407) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.126:45489(127.2.42.126:45489): Connection refused: /127.2.42.126:45489,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.125:42983(127.2.42.125:42983): Connection refused: /127.2.42.125:42983,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.42.124:36407(127.2.42.124:36407): Connection refused: /127.2.42.124:36407
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.42.124:36407
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:20.836 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:20.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
23:48:20.850 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:48:20.851 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state RUNNING to RESTARTING.
23:48:20.855 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
23:48:20.877 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:20.877 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:20.878 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:20.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.879 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.879 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.879 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:20.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:20.879 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.879 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.880 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:20.881 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:20.915 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.2.42.124:36407, [3ms] received response from server master-127.2.42.124:36407: OK, deferred=null) with no deferred attached!
23:48:20.961 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:21.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468101091 for job 6446e0085b210020482ce7a622d23630.
23:48:21.101 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:21.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
23:48:21.110 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:48:21.127 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:21.149 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:21.164 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:48:21.177 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:21.177 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:21.177 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:21.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.178 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.178 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.179 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.179 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:21.181 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:48:21.188 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:48:21.189 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:48:21.189 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:48:21.190 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:48:21.190 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:48:21.191 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:48:21.191 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:48:21.191 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:21.191 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:21.191 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:21.192 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:21.193 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:21.193 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:21.193 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:48:21.193 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:48:21.193 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:48:21.193 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:48:21.193 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:48:21.193 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:21.193 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:21.194 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:21.194 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:21.194 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:21.194 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:21.194 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_3c08b885f6e3e6c7b83114985ede33db/blobStorage
23:48:21.195 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:35925 - max concurrent requests: 50 - max backlog: 1000
23:48:21.196 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3c08b885f6e3e6c7b83114985ede33db/blobStorage
23:48:21.197 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3c08b885f6e3e6c7b83114985ede33db/blobStorage
23:48:21.197 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:48:21.198 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: c95b8a24-c846-4917-9363-7149c0489232
23:48:21.200 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:48:21.200 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-8cd49890-9e9f-4619-8bbf-3e8d92b82b30
23:48:21.205 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-c73963f3-fd87-49d4-9e63-a71ef97a3163
23:48:21.280 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:48:21.281 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:48:21.281 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:48:21.281 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:48:21.282 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:48:21.284 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_8 .
23:48:21.289 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
23:48:21.289 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-10cc8649-7e66-4083-87da-0ada62f45fc2
23:48:21.290 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:48:21.290 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:48:21.298 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:48:21.298 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:48:21.305 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:42037
23:48:21.306 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:48:21.307 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:42037 was granted leadership with leaderSessionID=671d1a31-4f7e-4f79-b9bf-7e688ce6cc59
23:48:21.307 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:42037 , session=671d1a31-4f7e-4f79-b9bf-7e688ce6cc59
23:48:21.308 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:48:21.308 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:48:21.308 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:48:21.308 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 64d9f3b4-c148-40e5-bb54-148e0777f32f. Creating new DispatcherLeaderProcess.
23:48:21.308 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:48:21.309 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:48:21.309 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:48:21.309 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:48:21.311 [INFO - pool-91-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 6489d32e-abda-40e2-a708-02cd140792ef.
23:48:21.312 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_9 .
23:48:21.313 [INFO - pool-91-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_10 .
23:48:21.318 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
23:48:21.319 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:48:21.319 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:48:21.319 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:48:21.319 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:48:21.320 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_10 , session=6489d32e-abda-40e2-a708-02cd140792ef
23:48:21.321 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(a70802cd140792ef6489d32eabda40e2).
23:48:21.321 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_9 , session=64d9f3b4-c148-40e5-bb54-148e0777f32f
23:48:21.363 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:21.366 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (6b15b774f375318429e8c166741c1d9d).
23:48:21.367 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (6b15b774f375318429e8c166741c1d9d).
23:48:21.367 [INFO - flink-pekko.actor.default-dispatcher-9] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-6b15b774f375318429e8c166741c1d9d'.
23:48:21.367 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 6b15b774f375318429e8c166741c1d9d was granted leadership with leader id a66670da-2511-465f-a48d-434514987765. Creating new JobMasterServiceProcess.
23:48:21.369 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1080) Registering TaskManager with ResourceID c95b8a24-c846-4917-9363-7149c0489232 (pekko://flink/user/rpc/taskmanager_8) at ResourceManager
23:48:21.370 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_10 under registration id 508cb5f20d45f74a92b8d9c1e2e61e61.
23:48:21.370 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor c95b8a24-c846-4917-9363-7149c0489232 under 508cb5f20d45f74a92b8d9c1e2e61e61 at the slot manager.
23:48:21.374 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_11 .
23:48:21.379 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (6b15b774f375318429e8c166741c1d9d).
23:48:21.380 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (6b15b774f375318429e8c166741c1d9d).
23:48:21.380 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 960d4d7fbe7ff7977bf98ecf6e7e1f7a for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.380 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (6b15b774f375318429e8c166741c1d9d).
23:48:21.380 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:48:21.382 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
23:48:21.382 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17f6abe9
23:48:21.382 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:21.382 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:21.383 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:48:21.384 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@4d64be12 for Flink Streaming Job (6b15b774f375318429e8c166741c1d9d).
23:48:21.384 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_11 , session=a66670da-2511-465f-a48d-434514987765
23:48:21.385 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (6b15b774f375318429e8c166741c1d9d) under job master id a48d434514987765a66670da2511465f.
23:48:21.385 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:48:21.387 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.388 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:48:21.388 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b15b774f375318429e8c166741c1d9d) switched from state CREATED to RUNNING.
23:48:21.389 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:48:21.390 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:48:21.390 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:48:21.390 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:48:21.391 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(a70802cd140792ef6489d32eabda40e2)
23:48:21.392 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:21.393 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager a48d434514987765a66670da2511465f@pekko://flink/user/rpc/jobmanager_11 for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.395 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:21.396 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:21.397 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.195.124:40929(127.5.195.124:40929)] Successfully connected to peer
23:48:21.402 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager a48d434514987765a66670da2511465f@pekko://flink/user/rpc/jobmanager_11 for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.406 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.124
23:48:21.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:21.415 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a70802cd140792ef6489d32eabda40e2.
23:48:21.415 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.195.126:36941(127.5.195.126:36941)] Successfully connected to peer
23:48:21.418 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:21.419 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:21.421 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.195.125:41211(127.5.195.125:41211)] Successfully connected to peer
23:48:21.424 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.425 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.126
23:48:21.426 [DEBUG - main] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:21.428 [DEBUG - main] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:21.428 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.125
23:48:21.431 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdef16c57, L:/127.0.0.1:43888 - R:/127.5.195.124:40929] using SASL/PLAIN
23:48:21.433 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 6b15b774f375318429e8c166741c1d9d
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager c95b8a24-c846-4917-9363-7149c0489232
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:48:21.434 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a857b45a30f1252b1fcc0c16c9bf115a from c95b8a24-c846-4917-9363-7149c0489232 for job 6b15b774f375318429e8c166741c1d9d with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.435 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 532cad1ce9bc484a8df8730b4379ae15 from c95b8a24-c846-4917-9363-7149c0489232 for job 6b15b774f375318429e8c166741c1d9d with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.435 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request a857b45a30f1252b1fcc0c16c9bf115a for job 6b15b774f375318429e8c166741c1d9d from resource manager with leader id a70802cd140792ef6489d32eabda40e2.
23:48:21.435 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for a857b45a30f1252b1fcc0c16c9bf115a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.435 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:21.436 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=43), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [40ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: OK, deferred=null) after lookup
23:48:21.436 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 689d84fe30510664cb4c992d23e6dc0a from c95b8a24-c846-4917-9363-7149c0489232 for job 6b15b774f375318429e8c166741c1d9d with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.437 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 7b1f70b00c2a8ee4ccf39cae7c72c607 from c95b8a24-c846-4917-9363-7149c0489232 for job 6b15b774f375318429e8c166741c1d9d with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.438 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:21.441 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0581a9cc392a4c22bd5d60a253a247a9 for table 'replication_test_table' with partition [<start>, <end>)
23:48:21.441 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0581a9cc392a4c22bd5d60a253a247a9@[3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721),c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)[L],f3fde060d3504b499957cf300a35fe9d(127.5.195.67:33791)]}]
23:48:21.443 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.444 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.114.125:39367(127.6.114.125:39367)] Successfully connected to peer
23:48:21.446 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x710a3fc6, L:/127.0.0.1:60506 - R:/127.5.195.126:36941] using SASL/PLAIN
23:48:21.448 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.450 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe0d821d9, L:/127.0.0.1:53980 - R:/127.5.195.125:41211] using SASL/PLAIN
23:48:21.452 [DEBUG - main] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:21.452 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 6b15b774f375318429e8c166741c1d9d for job leader monitoring.
23:48:21.453 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 532cad1ce9bc484a8df8730b4379ae15 for job 6b15b774f375318429e8c166741c1d9d from resource manager with leader id a70802cd140792ef6489d32eabda40e2.
23:48:21.453 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 532cad1ce9bc484a8df8730b4379ae15 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.453 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 689d84fe30510664cb4c992d23e6dc0a for job 6b15b774f375318429e8c166741c1d9d from resource manager with leader id a70802cd140792ef6489d32eabda40e2.
23:48:21.453 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 689d84fe30510664cb4c992d23e6dc0a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.454 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 7b1f70b00c2a8ee4ccf39cae7c72c607 for job 6b15b774f375318429e8c166741c1d9d from resource manager with leader id a70802cd140792ef6489d32eabda40e2.
23:48:21.454 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 7b1f70b00c2a8ee4ccf39cae7c72c607 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:21.455 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_11 with leader id a66670da-2511-465f-a48d-434514987765.
23:48:21.456 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:48:21.457 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.125
23:48:21.458 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.114.124:34801(127.6.114.124:34801)] Successfully connected to peer
23:48:21.459 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_11 for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.459 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.459 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6b15b774f375318429e8c166741c1d9d.
23:48:21.461 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:48:21.461 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id a857b45a30f1252b1fcc0c16c9bf115a
23:48:21.462 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:48:21.462 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a857b45a30f1252b1fcc0c16c9bf115a.
23:48:21.462 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 532cad1ce9bc484a8df8730b4379ae15
23:48:21.463 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:48:21.463 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 7b1f70b00c2a8ee4ccf39cae7c72c607
23:48:21.464 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.464 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:48:21.464 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 6b15b774f375318429e8c166741c1d9d
23:48:21.465 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id a857b45a30f1252b1fcc0c16c9bf115a.
23:48:21.465 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:48:21.465 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 689d84fe30510664cb4c992d23e6dc0a
23:48:21.466 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 532cad1ce9bc484a8df8730b4379ae15.
23:48:21.468 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 532cad1ce9bc484a8df8730b4379ae15.
23:48:21.468 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:48:21.469 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:48:21.469 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:48:21.470 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@797ad72e
23:48:21.470 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:21.470 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:21.471 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.114.126:40573(127.6.114.126:40573)] Successfully connected to peer
23:48:21.471 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:21.472 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:21.473 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.126
23:48:21.473 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:48:21.474 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:48:21.474 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:48:21.475 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2aeb598
23:48:21.475 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:21.475 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:21.476 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:21.476 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:21.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a857b45a30f1252b1fcc0c16c9bf115a.
23:48:21.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 532cad1ce9bc484a8df8730b4379ae15.
23:48:21.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:48:21.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 689d84fe30510664cb4c992d23e6dc0a.
23:48:21.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 689d84fe30510664cb4c992d23e6dc0a.
23:48:21.480 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4316ab14
23:48:21.482 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.483 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 689d84fe30510664cb4c992d23e6dc0a.
23:48:21.484 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:48:21.484 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:48:21.485 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.124
23:48:21.487 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x89dbb9bc, L:/127.0.0.1:36528 - R:/127.6.114.125:39367] using SASL/PLAIN
23:48:21.488 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:48:21.488 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:48:21.491 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a84567f
23:48:21.491 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:21.491 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:21.492 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:21.492 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:21.494 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27b64e72
23:48:21.495 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@155096a4
23:48:21.495 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.495 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:21.495 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:21.495 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:21.496 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:21.497 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.498 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:21.499 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.501 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3c24bf9e, L:/127.0.0.1:55138 - R:/127.6.114.124:34801] using SASL/PLAIN
23:48:21.501 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.503 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:21.503 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:21.504 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=78), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: OK, deferred=null) after lookup
23:48:21.505 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:21.506 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.114.125:39367(127.6.114.125:39367)] Successfully connected to peer
23:48:21.506 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.507 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd388e294, L:/127.0.0.1:48632 - R:/127.6.114.126:40573] using SASL/PLAIN
23:48:21.508 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:21.509 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.114.126:40573(127.6.114.126:40573)] Successfully connected to peer
23:48:21.510 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet df3ef3833d2d406e96c8218627391e44 for table 'replication_test_table' with partition [<start>, <end>)
23:48:21.511 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=df3ef3833d2d406e96c8218627391e44@[1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)[L],8a7b3dfc53cd4620bf89732518171bde(127.6.114.66:44747),efec05789b2e4188af7d674a2631288c(127.6.114.67:35947)]}]
23:48:21.511 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.6.114.124:34801, [3ms] Sub RPC GetTableLocations: received response from server master-127.6.114.124:34801: OK, deferred=null)) after lookup
23:48:21.511 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] connecting to peer
23:48:21.511 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.126
23:48:21.511 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6abc4a
23:48:21.515 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.114.124:34801(127.6.114.124:34801)] Successfully connected to peer
23:48:21.517 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3324df90
23:48:21.518 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:21.519 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:21.519 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.125
23:48:21.519 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.519 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.519 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.519 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.521 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.525 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.124
23:48:21.527 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.530 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x67cec435, L:/127.0.0.1:36542 - R:/127.6.114.125:39367] using SASL/PLAIN
23:48:21.533 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbadd73fa, L:/127.0.0.1:48642 - R:/127.6.114.126:40573] using SASL/PLAIN
23:48:21.535 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:21.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.535 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:21.536 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.537 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.537 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.537 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.537 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:21.537 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.114.125:39367(127.6.114.125:39367)] Successfully connected to peer
23:48:21.539 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.125
23:48:21.539 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:21.543 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.547 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa569cb70, L:/127.0.0.1:55144 - R:/127.6.114.124:34801] using SASL/PLAIN
23:48:21.549 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] Successfully connected to peer
23:48:21.550 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:21.550 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=52), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [33ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: OK, [51ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: OK, deferred=null) after lookup
23:48:21.552 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.554 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:21.555 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:21.555 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.555 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:21.556 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:21.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:21.558 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.558 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.558 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:21.558 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:21.559 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a491a86
23:48:21.559 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4c822837, L:/127.0.0.1:36558 - R:/127.6.114.125:39367] using SASL/PLAIN
23:48:21.560 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:48:21.560 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:48:21.563 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:21.564 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:21.564 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:21.565 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.114.125:39367(127.6.114.125:39367)] Successfully connected to peer
23:48:21.566 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.114.126:40573(127.6.114.126:40573)] Successfully connected to peer
23:48:21.568 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.125
23:48:21.569 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.573 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x21428f94, L:/127.0.0.1:60784 - R:/127.6.114.65:39287] using TOKEN/null
23:48:21.573 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.126
23:48:21.581 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.583 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.584 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.114.124:34801(127.6.114.124:34801)] Successfully connected to peer
23:48:21.587 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa17147f3, L:/127.0.0.1:36560 - R:/127.6.114.125:39367] using SASL/PLAIN
23:48:21.588 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.124
23:48:21.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468101591 for job 6446e0085b210020482ce7a622d23630.
23:48:21.593 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.597 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:21.598 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8c33ac2b, L:/127.0.0.1:48658 - R:/127.6.114.126:40573] using SASL/PLAIN
23:48:21.603 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.114.125:39367(127.6.114.125:39367)] Successfully connected to peer
23:48:21.606 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:21.607 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.125
23:48:21.608 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
23:48:21.609 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:21.613 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.114.126:40573(127.6.114.126:40573)] Successfully connected to peer
23:48:21.616 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.616 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.126
23:48:21.619 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5a55504c, L:/127.0.0.1:55152 - R:/127.6.114.124:34801] using SASL/PLAIN
23:48:21.622 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.623 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:21.623 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.114.124:34801(127.6.114.124:34801)] Successfully connected to peer
23:48:21.623 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=121), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [57ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: OK, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [96ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: OK, deferred=null) after lookup
23:48:21.625 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.124
23:48:21.627 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:21.627 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb713c737, L:/127.0.0.1:36566 - R:/127.6.114.125:39367] using SASL/PLAIN
23:48:21.627 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.628 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.114.126:40573(127.6.114.126:40573)] Successfully connected to peer
23:48:21.630 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.631 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@115303da
23:48:21.632 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.114.124:34801(127.6.114.124:34801)] Successfully connected to peer
23:48:21.633 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:21.634 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e18db5e9e5584732de335668d7d84543d70a441bc99d08ae32b39e4bc9df894d'}]
23:48:21.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:48:21.637 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:48:21.637 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.638 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.648 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:21.651 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:21.652 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.124
23:48:21.653 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:21.655 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:21.656 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=0581a9cc392a4c22bd5d60a253a247a9@[3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)[L],c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627),f3fde060d3504b499957cf300a35fe9d(127.5.195.67:33791)]}]
23:48:21.657 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] connecting to peer
23:48:21.660 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.665 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.114.126
23:48:21.666 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] Successfully connected to peer
23:48:21.671 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb7c4c29f, L:/127.0.0.1:48674 - R:/127.6.114.126:40573] using SASL/PLAIN
23:48:21.673 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.675 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.65
23:48:21.678 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.679 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5444c79d, L:/127.0.0.1:55164 - R:/127.6.114.124:34801] using SASL/PLAIN
23:48:21.682 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:21.682 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.682 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=145), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [67ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: OK, [114ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: OK, [119ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: OK, deferred=null) after lookup
23:48:21.684 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.686 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.687 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2b60739e, L:/127.0.0.1:48686 - R:/127.6.114.126:40573] using SASL/PLAIN
23:48:21.687 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x695f8f45, L:/127.0.0.1:45554 - R:/127.5.195.65:44721] using SASL/PLAIN
23:48:21.697 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.697 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd8d6daf1, L:/127.0.0.1:55170 - R:/127.6.114.124:34801] using SASL/PLAIN
23:48:21.700 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:21.701 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [50ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: OK, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [161ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: OK, [161ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: OK, deferred=null) after lookup
23:48:21.703 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.703 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@34f91a31
23:48:21.704 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.705 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:48:21.705 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:48:21.706 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:21.707 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5862a88e
23:48:21.709 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:48:21.709 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:48:21.710 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:21.711 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:21.712 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:21.713 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:21.728 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7305085343301632001) for scanner KuduScanner(table=replication_test_table, tablet=0581a9cc392a4c22bd5d60a253a247a9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.729 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [e18db5e9e5584732de335668d7d84543d70a441bc99d08ae32b39e4bc9df894d]
23:48:21.730 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:21.735 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2538) Learned about tablet df3ef3833d2d406e96c8218627391e44 for table 'replication_test_table' with partition [<start>, <end>)
23:48:21.736 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=df3ef3833d2d406e96c8218627391e44@[1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)[L],8a7b3dfc53cd4620bf89732518171bde(127.6.114.66:44747),efec05789b2e4188af7d674a2631288c(127.6.114.67:35947)]}]
23:48:21.737 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e18db5e9e5584732de335668d7d84543d70a441bc99d08ae32b39e4bc9df894d]
23:48:21.739 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e18db5e9e5584732de335668d7d84543d70a441bc99d08ae32b39e4bc9df894d finished by subtask 1; deferring removal (restored in pending)
23:48:21.739 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:21.739 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:21.740 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] disconnecting while in state READY
23:48:21.741 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:21.752 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.763 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] handling channelInactive
23:48:21.763 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] cleaning up while in state READY due to: connection closed
23:48:21.764 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:48:21.764 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:21.807 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.861 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.890 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state RESTARTING to RUNNING.
23:48:21.893 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job bbc34d76ac15add629743db00c4f4a33 from Checkpoint 66 @ 1783468100667 for bbc34d76ac15add629743db00c4f4a33 located at file:/tmp/junit16513366076383754312/checkpoints/bbc34d76ac15add629743db00c4f4a33/chk-66.
23:48:21.902 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468101902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:21.905 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=504, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@74cf6579, flushNotification=Deferred@941385257(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:21.909 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] connecting to peer
23:48:21.915 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
23:48:21.916 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.919 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 66 for source Source: KuduSource to checkpoint.
23:48:21.923 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
23:48:21.925 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:21.927 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
23:48:21.927 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758
23:48:21.929 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:48:21.931 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:48:21.941 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] Successfully connected to peer
23:48:21.949 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
23:48:21.949 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
23:48:21.950 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@76fa92c8
23:48:21.950 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:21.950 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:48:21.951 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:48:21.951 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:48:21.954 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@33aaae1c
23:48:21.957 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:21.957 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:21.961 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x647b5463, L:/127.0.0.1:60800 - R:/127.6.114.65:39287] using TOKEN/null
23:48:21.962 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:21.963 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:21.964 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:21.964 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:21.964 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:21.965 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:21.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:21.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:21.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:21.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:21.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:21.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:21.967 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:21.979 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:21.983 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:21.986 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:21.987 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:21.987 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:21.987 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:21.989 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:21.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:21.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:21.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.021 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.021 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.021 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.021 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.034 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:22.043 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.059 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.061 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.061 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.064 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.065 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.065 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.065 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.067 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.067 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.067 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.068 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 6b15b774f375318429e8c166741c1d9d (1581 bytes, checkpointDuration=165 ms, finalizationTime=1 ms).
23:48:22.070 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:48:22.070 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split e18db5e9e5584732de335668d7d84543d70a441bc99d08ae32b39e4bc9df894d from pending
23:48:22.070 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
23:48:22.083 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.083 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.084 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.084 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.084 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.084 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.084 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.084 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.084 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.084 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.085 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.090 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:22.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468102091 for job 6446e0085b210020482ce7a622d23630.
23:48:22.093 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:22.096 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:22.099 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:22.102 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:22.102 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.103 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.103 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:22.103 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.104 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.104 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.104 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.104 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.104 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.104 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.105 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.105 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
23:48:22.106 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:22.108 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4facac77cd1745f1973066e613204f01
23:48:22.117 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0581a9cc392a4c22bd5d60a253a247a9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:22.122 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:22.129 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0581a9cc392a4c22bd5d60a253a247a9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:22.139 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df3ef3833d2d406e96c8218627391e44, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:22.140 [DEBUG - main] (Connection.java:575) [peer master-127.6.114.125:39367(127.6.114.125:39367)] disconnecting while in state READY
23:48:22.140 [DEBUG - main] (Connection.java:575) [peer master-127.6.114.124:34801(127.6.114.124:34801)] disconnecting while in state READY
23:48:22.140 [DEBUG - main] (Connection.java:575) [peer master-127.6.114.126:40573(127.6.114.126:40573)] disconnecting while in state READY
23:48:22.140 [DEBUG - main] (Connection.java:575) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] disconnecting while in state READY
23:48:22.140 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.114.125:39367(127.6.114.125:39367)] handling channelInactive
23:48:22.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state READY due to: connection closed
23:48:22.140 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.114.124:34801(127.6.114.124:34801)] handling channelInactive
23:48:22.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state READY due to: connection closed
23:48:22.141 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.114.126:40573(127.6.114.126:40573)] handling channelInactive
23:48:22.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state READY due to: connection closed
23:48:22.142 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:22.142 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.143 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.143 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.144 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:48:22.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.144 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.144 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:22.149 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
23:48:22.154 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] handling channelInactive
23:48:22.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] cleaning up while in state READY due to: connection closed
23:48:22.154 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
23:48:22.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.154358  6601 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6887
23:48:22.163 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.163 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.164 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.164 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.164 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.165 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.165 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.165 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.165 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.197 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:22.197 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:22.198 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:22.199 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:22.199 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:22.199 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:22.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:22.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:22.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:22.201 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:22.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:22.201 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:22.201 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:22.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.203783  7010 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:22.237 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:22.237 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:22.238 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:22.238 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:22.238 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:22.238 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:22.238 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:22.238 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:22.239 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:22.239 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:22.239 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:22.239 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:22.239 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:22.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:22.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.304 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.305 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.305 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.306 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.306 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.306 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.306 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.307 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.347 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.347 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.347 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.348 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.348 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.348 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.348 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.349 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468102402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:22.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.409584  6601 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6887
23:48:22.428 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=26 ms, finalizationTime=0 ms).
23:48:22.430 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:48:22.439 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] handling channelInactive
23:48:22.439 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] cleaning up while in state READY due to: connection closed
23:48:22.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.440955  6601 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 7023
23:48:22.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.449393  7148 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:22.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.560743  6601 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 7023
23:48:22.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.582542  6601 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 7163
23:48:22.582 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:22.583 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:22.583 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:22.584 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.584 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.584 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:22.584 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.585 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.585 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:22.585 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.585 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:22.586 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:22.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468102591 for job 6446e0085b210020482ce7a622d23630.
23:48:22.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.601281  7286 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:22.603 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:22.606 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
23:48:22.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.707973  6601 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 7163
23:48:22.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.728271  6601 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6613
23:48:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.729873  6674 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:22.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:22.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.864459  6601 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6613
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.114.126:40573(127.6.114.126:40573)] handling channelInactive
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.114.126:40573(127.6.114.126:40573)] handling channelInactive
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state READY due to: connection closed
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state READY due to: connection closed
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.114.126:40573(127.6.114.126:40573)] handling channelInactive
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state READY due to: connection closed
23:48:22.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.888478  6601 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6681
23:48:22.887 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.114.126:40573(127.6.114.126:40573)] handling channelInactive
23:48:22.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state READY due to: connection closed
23:48:22.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:22.889812  6748 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:22.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468102902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:22.924 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=20 ms, finalizationTime=2 ms).
23:48:22.927 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:48:23.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.060153  6601 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6681
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.114.125:39367(127.6.114.125:39367)] handling channelInactive
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.114.125:39367(127.6.114.125:39367)] handling channelInactive
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state READY due to: connection closed
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.114.125:39367(127.6.114.125:39367)] handling channelInactive
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state READY due to: connection closed
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state READY due to: connection closed
23:48:23.091 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.114.125:39367(127.6.114.125:39367)] handling channelInactive
23:48:23.092 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state READY due to: connection closed
23:48:23.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468103091 for job 6446e0085b210020482ce7a622d23630.
23:48:23.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.093101  6601 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6755
23:48:23.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.094480  6820 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:23.102 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:23.103 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:23.104 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:23.104 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
23:48:23.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:23.105 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:23.105 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:23.105 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:23.106 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:23.106 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:23.106 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:23.106 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:23.106 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:23.107 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:23.107 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
23:48:23.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.237375  6601 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6755
23:48:23.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.114.124:34801(127.6.114.124:34801)] handling channelInactive
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state READY due to: connection closed
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.114.124:34801(127.6.114.124:34801)] handling channelInactive
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state READY due to: connection closed
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.114.124:34801(127.6.114.124:34801)] handling channelInactive
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state READY due to: connection closed
23:48:23.262 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.114.124:34801(127.6.114.124:34801)] handling channelInactive
23:48:23.263 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state READY due to: connection closed
23:48:23.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:23Z chronyd exiting
23:48:23.392 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c79cdb724e40418d83a1ef8c16fc7ba7
23:48:23.394 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='26ac416acfef6f9d012b462a3c5762f9f6018572e96743a5242536fd930fa241'}]
23:48:23.398 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:23.399 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:23.400 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298047, tablet=0581a9cc392a4c22bd5d60a253a247a9@[3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)[L],c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627),f3fde060d3504b499957cf300a35fe9d(127.5.195.67:33791)]}]
23:48:23.401 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] connecting to peer
23:48:23.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468103402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:23.414 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 6b15b774f375318429e8c166741c1d9d (1591 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:23.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:48:23.418 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] Successfully connected to peer
23:48:23.420 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.195.65
23:48:23.430 [DEBUG - main] (Connection.java:575) [peer c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)] disconnecting while in state READY
23:48:23.430 [DEBUG - main] (Connection.java:575) [peer master-127.5.195.124:40929(127.5.195.124:40929)] disconnecting while in state READY
23:48:23.430 [DEBUG - main] (Connection.java:575) [peer master-127.5.195.126:36941(127.5.195.126:36941)] disconnecting while in state READY
23:48:23.430 [DEBUG - main] (Connection.java:575) [peer master-127.5.195.125:41211(127.5.195.125:41211)] disconnecting while in state READY
23:48:23.431 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)] handling channelInactive
23:48:23.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c3f013f8ac664ac0b15edcdaed3bc059(127.5.195.66:38627)] cleaning up while in state READY due to: connection closed
23:48:23.432 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.195.124:40929(127.5.195.124:40929)] handling channelInactive
23:48:23.432 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state READY due to: connection closed
23:48:23.432 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.195.126:36941(127.5.195.126:36941)] handling channelInactive
23:48:23.433 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state READY due to: connection closed
23:48:23.433 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:23.433 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:23.435 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
23:48:23.435 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
23:48:23.436 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
23:48:23.436 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0fa27c6e, L:/127.0.0.1:45564 - R:/127.5.195.65:44721] using SASL/PLAIN
23:48:23.439 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.195.125:41211(127.5.195.125:41211)] handling channelInactive
23:48:23.439 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state READY due to: connection closed
23:48:23.439 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
23:48:23.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.439929  5901 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6187
23:48:23.449 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085351481344001) for scanner KuduScanner(table=replication_test_table, tablet=0581a9cc392a4c22bd5d60a253a247a9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:23.450 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [26ac416acfef6f9d012b462a3c5762f9f6018572e96743a5242536fd930fa241]
23:48:23.450 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [26ac416acfef6f9d012b462a3c5762f9f6018572e96743a5242536fd930fa241]
23:48:23.451 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:23.451 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:23.452 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 26ac416acfef6f9d012b462a3c5762f9f6018572e96743a5242536fd930fa241 finished by subtask 0; deferring removal (restored in pending)
23:48:23.452 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] disconnecting while in state READY
23:48:23.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.452939  6310 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:23.453 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:23.456 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:23.456 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] handling channelInactive
23:48:23.457 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 3efe4d45f9194c6d8686d03b8f5ee41f(127.5.195.65:44721)] cleaning up while in state READY due to: connection closed
23:48:23.457 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:23.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468103591 for job 6446e0085b210020482ce7a622d23630.
23:48:23.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.594075  5901 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6187
23:48:23.603 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:23.604 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
23:48:23.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.622347  5901 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6323
23:48:23.623 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:23.623 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:23.624 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:23.624 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:23.624 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:23.624 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:23.624 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:23.624 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:23.624 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:23.624 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:23.624 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:23.624 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:23.625 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:23.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.630687  6449 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:23.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:23.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.770495  5901 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6323
23:48:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:23.796833  6480 connection.cc:573] server connection from 127.5.195.66:60345 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:23.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.797161  5901 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6462
23:48:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.806252  6586 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:23.897 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:23.897 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:23.897 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:23.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:23.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:23.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:23.898 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:23.898 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:23.898 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:23.898 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:23.898 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:23.898 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:23.899 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:23.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468103902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:23.912 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 6b15b774f375318429e8c166741c1d9d (1591 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:23.914 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:48:23.915 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 26ac416acfef6f9d012b462a3c5762f9f6018572e96743a5242536fd930fa241 from pending
23:48:23.915 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
23:48:23.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.920120  5901 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6462
23:48:23.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.942332  5901 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 5912
23:48:23.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:23.943877  5974 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.072868  5901 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 5912
23:48:24.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468104091 for job 6446e0085b210020482ce7a622d23630.
23:48:24.098 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.195.126:36941(127.5.195.126:36941)] handling channelInactive
23:48:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.098105  5901 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 5981
23:48:24.099 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state READY due to: connection closed
23:48:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.099462  6046 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:24.100 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:24.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
23:48:24.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:24.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:24.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:24.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:24.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:24.195 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:24.195 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:24.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:24.195 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:24.195 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:24.195 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:24.195 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:24.195 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:24.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.218916  5901 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 5981
23:48:24.241 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.195.125:41211(127.5.195.125:41211)] handling channelInactive
23:48:24.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.241771  5901 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 6054
23:48:24.242 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state READY due to: connection closed
23:48:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.243434  6118 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:24.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:24.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.362375  5901 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 6054
23:48:24.387 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.195.124:40929(127.5.195.124:40929)] handling channelInactive
23:48:24.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state READY due to: connection closed
23:48:24.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468104402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:24.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:24Z chronyd exiting
23:48:24.413 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:24.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:48:24.498 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:24.499 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:24.499 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:24.499 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:24.499 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:24.500 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:24.500 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:24.500 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:24.500 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:24.500 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:24.500 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:24.500 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:24.500 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
.23:48:24.526 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468104526
23:48:24.526 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468104526
23:48:24.530 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:48:24.535 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:48:24.536 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:48:24.536 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:48:24.536 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:48:24.537 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:48:24.540 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:48:24.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468104591 for job 6446e0085b210020482ce7a622d23630.
23:48:24.600 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:24.600 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
23:48:24.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:24.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468104903 for job 6b15b774f375318429e8c166741c1d9d.
23:48:24.914 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:24.917 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:48:24.932 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:24.933 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:48:24.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.935853  7585 mini_oidc.cc:150] Starting JWKS server
23:48:24.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.938648  7585 webserver.cc:534] Webserver started at http://127.0.0.1:43417/ using document root <none> and password file <none>
23:48:24.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.939185  7585 mini_oidc.cc:186] Starting OIDC Discovery server
23:48:24.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.940022  7585 webserver.cc:534] Webserver started at http://127.0.0.1:45871/ using document root <none> and password file <none>
23:48:24.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:24Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:48:24.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:24Z Disabled control of system clock
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:24.976920  7585 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/logs
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data/info.pb
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.126:33577
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.126
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:24.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43417/jwks.json with env {}
23:48:25.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468105091 for job 6446e0085b210020482ce7a622d23630.
23:48:25.100 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:25.101 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
23:48:25.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.353917  7596 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.354316  7596 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.354460  7596 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.364024  7596 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.364179  7596 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.364262  7596 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.364319  7596 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.364403  7596 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.364455  7596 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43417/jwks.json
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.375973  7596 master_runner.cc:387] Master server non-default flags:
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.126:33577
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43417/jwks.json
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data/info.pb
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.126
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/logs
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:25.377 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:25.377 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:25.377 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:25.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.378221  7596 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:25.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.378 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.378 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.378 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.378 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:25.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.380796  7596 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:25.389 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.390837  7601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:25.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.390978  7602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:25.391 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.391747  7604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:25.391 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.392 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.5.195.124:40929(127.5.195.124:40929) for tablet Kudu Master: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.392230  7596 server_base.cc:1061] running on GCE node
23:48:25.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.393169  7596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:25.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.395421  7596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:25.395 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.396 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.396718  7596 hybrid_clock.cc:648] HybridClock initialized: now 1783468105396552 us; error 145 us; skew 500 ppm
23:48:25.397 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.397 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.397 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.397294  7596 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:25.397 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.398 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.398 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.398 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.398 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.398 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.398 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.399 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.400696  7596 webserver.cc:534] Webserver started at http://127.7.104.126:35013/ using document root <none> and password file <none>
23:48:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.401607  7596 fs_manager.cc:362] Metadata directory not provided
23:48:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.401764  7596 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:25.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.402299  7596 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:25.402 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468105402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.406282  7596 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data/instance:
23:48:25.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d901c757ca0044dc88490844632b7968"
23:48:25.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:25 on dist-test-slave-hfsf"
23:48:25.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.407781  7596 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal/instance:
23:48:25.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d901c757ca0044dc88490844632b7968"
23:48:25.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:25 on dist-test-slave-hfsf"
23:48:25.412 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:25.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
23:48:25.416 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.417 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.417 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.418 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.418 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.418 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.418 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.419 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.420 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.425726  7596 fs_manager.cc:696] Time spent creating directory manager: real 0.017s	user 0.011s	sys 0.004s
23:48:25.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.432140  7615 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:25.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.434188  7596 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.434525  7596 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d901c757ca0044dc88490844632b7968"
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:25 on dist-test-slave-hfsf"
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.435005  7596 fs_report.cc:389] FS layout report
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data/data
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:25.436 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.436 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.436 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.437 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.437 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.437 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.437 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.437 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.437 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.437 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.455 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.456 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.456 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.456 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.457 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.465790  7596 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:25.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.467166  7596 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:25.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.467523  7596 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:25.476 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.476 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.476 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.477 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.477 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.477 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.477 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.494567  7596 rpc_server.cc:307] RPC server started. Bound to: 127.7.104.126:33577
23:48:25.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.494580  7666 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.104.126:33577 every 8 connection(s)
23:48:25.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.496735  7596 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/data/info.pb
23:48:25.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.499742  7585 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 7596
23:48:25.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.500090  7585 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-0/wal/instance
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.502177  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.502696  7585 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:25.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/logs
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data/info.pb
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.125:36473
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.125
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43417/jwks.json with env {}
23:48:25.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.511031  7667 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } has no permanent_uuid. Determining permanent_uuid...
23:48:25.515 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.516 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.516 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.517 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.517 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.517 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.517 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.517 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.517 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.518 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.518 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.518 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.518 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.523 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:25.523 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:25.524 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:25.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:25.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:25.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:25.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:25.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:25.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:25.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:25.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:25.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:25.525 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:25.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.539525  7667 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } has no permanent_uuid. Determining permanent_uuid...
23:48:25.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.541162  7618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.104.125:36473: connect: Connection refused (error 111)
23:48:25.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.543556  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.125:36473: Network error: Client connection negotiation failed: client connection to 127.7.104.125:36473: connect: Connection refused (error 111)
23:48:25.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468105591 for job 6446e0085b210020482ce7a622d23630.
23:48:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.592969  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } attempt: 1
23:48:25.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.596367  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.125:36473: Network error: Client connection negotiation failed: client connection to 127.7.104.125:36473: connect: Connection refused (error 111)
23:48:25.602 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:25.603 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
23:48:25.615 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.616 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.617 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.617 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.617 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.618 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.618 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.618 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.618 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.618 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:25.619 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:25.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.619 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:25.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.619 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.619 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.619 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.620 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.620 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.620 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.620 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:25.656 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.656 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.656 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.657 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.657 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.657 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.657 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.664659  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } attempt: 2
23:48:25.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.667002  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.125:36473: Network error: Client connection negotiation failed: client connection to 127.7.104.125:36473: connect: Connection refused (error 111)
23:48:25.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:25.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.758318  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } attempt: 3
23:48:25.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.760599  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.125:36473: Network error: Client connection negotiation failed: client connection to 127.7.104.125:36473: connect: Connection refused (error 111)
23:48:25.822 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:25.822 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:25.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.823 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:25.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.823 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.824 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:25.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.891881  7669 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:25.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.892711  7669 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:25.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.893033  7669 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:25.895 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:25.896 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:25.896 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:25.900 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.900 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.900 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:25.901 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.901 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.901 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:25.901 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.901 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.901 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:25.901 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:25.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468105902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:25.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.903877  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } attempt: 4
23:48:25.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.907431  7669 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:25.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.907745  7669 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.907971  7669 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.908146  7669 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.908360  7669 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.908542  7669 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43417/jwks.json
23:48:25.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.909579  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.125:36473: Network error: Client connection negotiation failed: client connection to 127.7.104.125:36473: connect: Connection refused (error 111)
23:48:25.912 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:25.913 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
23:48:25.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.922513  7669 master_runner.cc:387] Master server non-default flags:
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.125:36473
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43417/jwks.json
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data/info.pb
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.125
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/logs
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:25.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.924758  7669 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:25.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.927052  7669 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:25.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.937352  7678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:25.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.937906  7680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:25.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:25.938062  7677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:25.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.938990  7669 server_base.cc:1061] running on GCE node
23:48:25.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.939966  7669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.941713  7669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:25.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.942930  7669 hybrid_clock.cc:648] HybridClock initialized: now 1783468105942845 us; error 64 us; skew 500 ppm
23:48:25.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.943367  7669 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:25.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.946370  7669 webserver.cc:534] Webserver started at http://127.7.104.125:35287/ using document root <none> and password file <none>
23:48:25.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.947451  7669 fs_manager.cc:362] Metadata directory not provided
23:48:25.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.947618  7669 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:25.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.948042  7669 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:25.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.951239  7669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data/instance:
23:48:25.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "784f2649e9544fbdbf6c74c739cb9e05"
23:48:25.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:25 on dist-test-slave-hfsf"
23:48:25.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.952215  7669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal/instance:
23:48:25.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "784f2649e9544fbdbf6c74c739cb9e05"
23:48:25.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:25 on dist-test-slave-hfsf"
23:48:25.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.958352  7669 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:48:25.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.962303  7686 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.964134  7669 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.964308  7669 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "784f2649e9544fbdbf6c74c739cb9e05"
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:25 on dist-test-slave-hfsf"
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.964504  7669 fs_report.cc:389] FS layout report
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data/data
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:25.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:25.979 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:25.979 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:25.980 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:25.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:25.980 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.980 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.980 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:25.980 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.980 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.981 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:25.981 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:25.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.993258  7669 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:25.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.994218  7669 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:25.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:25.994477  7669 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.017706  7669 rpc_server.cc:307] RPC server started. Bound to: 127.7.104.125:36473
23:48:26.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.017727  7737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.104.125:36473 every 8 connection(s)
23:48:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.019462  7669 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/data/info.pb
23:48:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.020944  7585 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 7669
23:48:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.021189  7585 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-1/wal/instance
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.022531  7585 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/logs
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data/info.pb
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:26.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.124:39307
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.124
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:26.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43417/jwks.json with env {}
23:48:26.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.025691  7738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:26.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.032837  7738 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.050141  7738 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.061371  7738 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.062749  7688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.064759  7738 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468106091 for job 6446e0085b210020482ce7a622d23630.
23:48:26.101 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:26.102 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
23:48:26.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.114156  7738 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 1
23:48:26.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.116446  7738 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.156 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:26.157 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:26.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:26.157 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:26.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:26.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:26.157 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:26.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:26.158 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:26.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:26.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:26.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:26.158 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:26.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.184737  7738 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 2
23:48:26.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.187347  7738 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.208849  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } attempt: 5
23:48:26.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.216688  7667 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.219221  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:26.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.270526  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 1
23:48:26.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.272939  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.278633  7738 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 3
23:48:26.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.281183  7738 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.341223  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 2
23:48:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.343768  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.402 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:26.402 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:26.403 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:26.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468106402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:26.403 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:26.403 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:26.403 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:26.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:26.403 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:26.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:26.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:26.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:26.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:26.404 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:26.412 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:26.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
23:48:26.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.419324  7740 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:26.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.419688  7740 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:26.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.419773  7740 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:26.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.424448  7738 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 4
23:48:26.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.426723  7738 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.429325  7740 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:26.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.429423  7740 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:26.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.429481  7740 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:26.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.429526  7740 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:26.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.429580  7740 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:26.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.429615  7740 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43417/jwks.json
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.440979  7740 master_runner.cc:387] Master server non-default flags:
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.124:39307
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43417/jwks.json
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data/info.pb
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.124
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/logs
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:26.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:26.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:26.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:26.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.442849  7740 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:26.443 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:26.444 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:26.444 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:26.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:26.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:26.444 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:26.444 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:26.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:26.444 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:26.444 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:26.444 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:26.444 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:26.445 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:26.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.445374  7740 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:26.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.450115  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 3
23:48:26.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.453140  7667 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.104.124:39307: Network error: Client connection negotiation failed: client connection to 127.7.104.124:39307: connect: Connection refused (error 111)
23:48:26.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.455752  7748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:26.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.455744  7751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:26.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.455719  7749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:26.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.456712  7740 server_base.cc:1061] running on GCE node
23:48:26.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.457557  7740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:26.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.459110  7740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:26.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.460299  7740 hybrid_clock.cc:648] HybridClock initialized: now 1783468106460249 us; error 88 us; skew 500 ppm
23:48:26.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.460652  7740 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:26.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.463922  7740 webserver.cc:534] Webserver started at http://127.7.104.124:39117/ using document root <none> and password file <none>
23:48:26.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.464737  7740 fs_manager.cc:362] Metadata directory not provided
23:48:26.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.464846  7740 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:26.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.465176  7740 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:26.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.468597  7740 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data/instance:
23:48:26.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6fa02e13bbdb48849e4c384ee2087c43"
23:48:26.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:26 on dist-test-slave-hfsf"
23:48:26.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.470331  7740 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal/instance:
23:48:26.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6fa02e13bbdb48849e4c384ee2087c43"
23:48:26.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:26 on dist-test-slave-hfsf"
23:48:26.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.477556  7740 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
23:48:26.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.482121  7757 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.484118  7740 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.484309  7740 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6fa02e13bbdb48849e4c384ee2087c43"
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:26 on dist-test-slave-hfsf"
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.484591  7740 fs_report.cc:389] FS layout report
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data/data
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:26.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:26.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.541729  7740 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:26.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.542745  7740 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:26.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.543119  7740 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.569024  7740 rpc_server.cc:307] RPC server started. Bound to: 127.7.104.124:39307
23:48:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.569044  7808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.104.124:39307 every 8 connection(s)
23:48:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.570971  7740 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/data/info.pb
23:48:26.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.576285  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:26.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.577935  7585 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 7740
23:48:26.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.578119  7585 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/master-2/wal/instance
23:48:26.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.584618  7809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468106591 for job 6446e0085b210020482ce7a622d23630.
23:48:26.613 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
23:48:26.614 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
23:48:26.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.630405  7667 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 4
23:48:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.635185  7809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.643793  7809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } has no permanent_uuid. Determining permanent_uuid...
23:48:26.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.647049  7667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: Bootstrap starting.
23:48:26.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.651237  7667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: Neither blocks nor log segments found. Creating new log.
23:48:26.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.652860  7667 log.cc:826] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: Log is configured to *not* fsync() on all Append() calls
23:48:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.655761  7667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: No bootstrap required, opened a new log
23:48:26.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.656754  7809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: Bootstrap starting.
23:48:26.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.660518  7809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: Neither blocks nor log segments found. Creating new log.
23:48:26.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.661871  7809 log.cc:826] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: Log is configured to *not* fsync() on all Append() calls
23:48:26.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.662076  7667 raft_consensus.cc:359] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.662401  7667 raft_consensus.cc:385] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:26.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.662535  7667 raft_consensus.cc:740] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d901c757ca0044dc88490844632b7968, State: Initialized, Role: FOLLOWER
23:48:26.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.663352  7667 consensus_queue.cc:260] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.664451  7819 sys_catalog.cc:455] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.664757  7819 sys_catalog.cc:458] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: This master's current role is: FOLLOWER
23:48:26.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.665136  7809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: No bootstrap required, opened a new log
23:48:26.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.665710  7667 sys_catalog.cc:565] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: configured and running, proceeding with master startup.
23:48:26.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.672561  7809 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.672986  7809 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:26.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.673121  7809 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa02e13bbdb48849e4c384ee2087c43, State: Initialized, Role: FOLLOWER
23:48:26.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.673909  7809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.679067  7809 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: configured and running, proceeding with master startup.
23:48:26.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.679258  7827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.679545  7827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: This master's current role is: FOLLOWER
23:48:26.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.685815  7831 catalog_manager.cc:1593] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:26.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.686030  7831 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:26.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.681344  7596 master_runner.cc:187] Error getting master registration for 127.7.104.125:36473: OK, instance_id { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" instance_seqno: 1783468106011755 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:26.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.686729  7596 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:26.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.696422  7843 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:26.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.696861  7843 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:26.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.697180  7740 master_runner.cc:187] Error getting master registration for 127.7.104.125:36473: OK, instance_id { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" instance_seqno: 1783468106011755 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:26.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.704499  7740 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:26.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.721423  7621 tablet.cc:2406] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:26.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.726020  7738 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } attempt: 5
23:48:26.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.740893  7738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: Bootstrap starting.
23:48:26.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.745827  7738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: Neither blocks nor log segments found. Creating new log.
23:48:26.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.747522  7738 log.cc:826] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: Log is configured to *not* fsync() on all Append() calls
23:48:26.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:26.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.754163  7738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: No bootstrap required, opened a new log
23:48:26.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.763768  7738 raft_consensus.cc:359] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.764623  7738 raft_consensus.cc:385] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:26.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.764950  7738 raft_consensus.cc:740] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 784f2649e9544fbdbf6c74c739cb9e05, State: Initialized, Role: FOLLOWER
23:48:26.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.766009  7738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.770162  7846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.770756  7846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: This master's current role is: FOLLOWER
23:48:26.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.771800  7738 sys_catalog.cc:565] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: configured and running, proceeding with master startup.
23:48:26.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.795820  7763 tablet.cc:2406] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:26.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.799885  7669 master_runner.cc:264] No leader master found from master 784f2649e9544fbdbf6c74c739cb9e05
23:48:26.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.800077  7669 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:26.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.803503  7819 raft_consensus.cc:493] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:26.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.803810  7819 raft_consensus.cc:515] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.805825  7819 leader_election.cc:290] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 784f2649e9544fbdbf6c74c739cb9e05 (127.7.104.125:36473), 6fa02e13bbdb48849e4c384ee2087c43 (127.7.104.124:39307)
23:48:26.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.807221  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d901c757ca0044dc88490844632b7968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "784f2649e9544fbdbf6c74c739cb9e05" is_pre_election: true
23:48:26.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.807912  7713 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d901c757ca0044dc88490844632b7968 in term 0.
23:48:26.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.808732  7618 leader_election.cc:304] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 784f2649e9544fbdbf6c74c739cb9e05, d901c757ca0044dc88490844632b7968; no voters: 
23:48:26.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.810488  7819 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:26.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.810678  7819 raft_consensus.cc:493] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:26.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.810782  7819 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 0 FOLLOWER]: Advancing to term 1
23:48:26.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.811084  7784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d901c757ca0044dc88490844632b7968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa02e13bbdb48849e4c384ee2087c43" is_pre_election: true
23:48:26.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.811650  7784 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d901c757ca0044dc88490844632b7968 in term 0.
23:48:26.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.815110  7819 raft_consensus.cc:515] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.816644  7713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d901c757ca0044dc88490844632b7968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "784f2649e9544fbdbf6c74c739cb9e05"
23:48:26.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.816892  7713 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 0 FOLLOWER]: Advancing to term 1
23:48:26.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.821290  7713 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d901c757ca0044dc88490844632b7968 in term 1.
23:48:26.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.822239  7618 leader_election.cc:304] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 784f2649e9544fbdbf6c74c739cb9e05, d901c757ca0044dc88490844632b7968; no voters: 
23:48:26.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.826776  7784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d901c757ca0044dc88490844632b7968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa02e13bbdb48849e4c384ee2087c43"
23:48:26.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.827121  7784 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 0 FOLLOWER]: Advancing to term 1
23:48:26.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.831699  7784 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d901c757ca0044dc88490844632b7968 in term 1.
23:48:26.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.835202  7819 leader_election.cc:290] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [CANDIDATE]: Term 1 election: Requested vote from peers 784f2649e9544fbdbf6c74c739cb9e05 (127.7.104.125:36473), 6fa02e13bbdb48849e4c384ee2087c43 (127.7.104.124:39307)
23:48:26.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.835952  7819 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 1 FOLLOWER]: Leader election won for term 1
23:48:26.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.836548  7819 raft_consensus.cc:697] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [term 1 LEADER]: Becoming Leader. State: Replica: d901c757ca0044dc88490844632b7968, State: Running, Role: LEADER
23:48:26.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.837574  7819 consensus_queue.cc:237] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } }
23:48:26.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.843079  7857 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:26.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:26.847482  7857 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:26.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.853502  7859 sys_catalog.cc:455] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d901c757ca0044dc88490844632b7968. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.853919  7859 sys_catalog.cc:458] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: This master's current role is: LEADER
23:48:26.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.865231  7861 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:48:26.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.868577  7861 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:48:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.885581  7713 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [term 1 FOLLOWER]: Refusing update from remote peer d901c757ca0044dc88490844632b7968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.885584  7784 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [term 1 FOLLOWER]: Refusing update from remote peer d901c757ca0044dc88490844632b7968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.886788  7859 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:26.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.888370  7859 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:26.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468106902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:26.917 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:26.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:26.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:26.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:26.920 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:26.920 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:26.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:26.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:26.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:26.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:26.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:26.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:26.921 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:26.922 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
23:48:26.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
23:48:26.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.943764  7846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d901c757ca0044dc88490844632b7968. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.948689  7846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: This master's current role is: FOLLOWER
23:48:26.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.950402  7862 mvcc.cc:204] Tried to move back new op lower bound from 7305085365789908992 to 7305085365633650688. Current Snapshot: MvccSnapshot[applied={T|T < 7305085365789908992}]
23:48:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.955178  7859 sys_catalog.cc:455] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.955505  7859 sys_catalog.cc:458] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: This master's current role is: LEADER
23:48:26.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.960294  7861 catalog_manager.cc:1382] Generated new cluster ID: 3581af44b0114d3b8cc44f5907718579
23:48:26.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.960435  7861 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:48:26.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.981603  7846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.981865  7846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05 [sys.catalog]: This master's current role is: FOLLOWER
23:48:26.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.989176  7827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d901c757ca0044dc88490844632b7968. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.989509  7827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: This master's current role is: FOLLOWER
23:48:26.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.993327  7819 sys_catalog.cc:455] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:26.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:26.994904  7819 sys_catalog.cc:458] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968 [sys.catalog]: This master's current role is: LEADER
23:48:27.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.003235  7827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d901c757ca0044dc88490844632b7968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d901c757ca0044dc88490844632b7968" member_type: VOTER last_known_addr { host: "127.7.104.126" port: 33577 } } peers { permanent_uuid: "784f2649e9544fbdbf6c74c739cb9e05" member_type: VOTER last_known_addr { host: "127.7.104.125" port: 36473 } } peers { permanent_uuid: "6fa02e13bbdb48849e4c384ee2087c43" member_type: VOTER last_known_addr { host: "127.7.104.124" port: 39307 } } }
23:48:27.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.003509  7827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43 [sys.catalog]: This master's current role is: FOLLOWER
23:48:27.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.056686  7861 catalog_manager.cc:1405] Generated new certificate authority record
23:48:27.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.061129  7861 catalog_manager.cc:1539] Loading token signing keys...
23:48:27.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468107091 for job 6446e0085b210020482ce7a622d23630.
23:48:27.104 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:27.105 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
23:48:27.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.115013  7861 catalog_manager.cc:6069] T 00000000000000000000000000000000 P d901c757ca0044dc88490844632b7968: Generated new TSK 0
23:48:27.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.116472  7861 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.128911  7585 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/logs
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data/info.pb
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.65:0
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.104.65
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.65
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:27.195 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:27.196 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:27.196 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:27.197 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:27.197 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:27.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:27.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:27.197 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:27.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:27.197 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:27.197 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:27.197 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:27.197 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:27.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:27.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468107402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:27.420 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
23:48:27.422 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
23:48:27.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468107591 for job 6446e0085b210020482ce7a622d23630.
23:48:27.602 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:27.602 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
23:48:27.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.659330  7870 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:27.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.659742  7870 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:27.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.659883  7870 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:27.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.670017  7870 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:27.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.670245  7870 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.104.65
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.682032  7870 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.65:0
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data/info.pb
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.65
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:27.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.104.65
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/logs
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:27.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:27.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.684095  7870 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:27.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.686038  7870 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.697044  7876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.697666  7877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:27.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:27.698559  7879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:27.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.699648  7870 server_base.cc:1061] running on GCE node
23:48:27.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.699733  7843 catalog_manager.cc:1294] Loaded cluster ID: 3581af44b0114d3b8cc44f5907718579
23:48:27.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.699868  7843 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: loading cluster ID for follower catalog manager: success
23:48:27.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.700383  7870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:27.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.701582  7870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:27.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.702847  7870 hybrid_clock.cc:648] HybridClock initialized: now 1783468107702748 us; error 55 us; skew 500 ppm
23:48:27.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.703217  7870 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:27.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.703769  7843 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: acquiring CA information for follower catalog manager: success
23:48:27.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.705909  7870 webserver.cc:534] Webserver started at http://127.7.104.65:45597/ using document root <none> and password file <none>
23:48:27.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.706513  7843 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6fa02e13bbdb48849e4c384ee2087c43: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:27.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.706785  7870 fs_manager.cc:362] Metadata directory not provided
23:48:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.706995  7870 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.707398  7870 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:27.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.710319  7870 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data/instance:
23:48:27.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:27.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:27 on dist-test-slave-hfsf"
23:48:27.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.711442  7870 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal/instance:
23:48:27.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:27.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:27 on dist-test-slave-hfsf"
23:48:27.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.717968  7870 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.006s
23:48:27.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.722718  7886 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.724799  7870 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.725010  7870 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:27 on dist-test-slave-hfsf"
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.725257  7870 fs_report.cc:389] FS layout report
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data/data
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:27.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.744752  7870 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:27.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.745852  7870 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:27.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.746201  7870 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:27.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:27.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.747781  7870 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:27.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.750444  7870 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:27.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.750548  7870 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:27.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.750627  7870 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:27.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.750674  7870 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:27.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.807458  7870 rpc_server.cc:307] RPC server started. Bound to: 127.7.104.65:45995
23:48:27.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.807761  7998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.104.65:45995 every 8 connection(s)
23:48:27.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.809078  7870 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/data/info.pb
23:48:27.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.810534  7585 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 7870
23:48:27.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.810746  7585 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-0/wal/instance
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.815253  7585 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/logs
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data/info.pb
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.66:0
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.104.66
23:48:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.66
23:48:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.851536  7857 catalog_manager.cc:1294] Loaded cluster ID: 3581af44b0114d3b8cc44f5907718579
23:48:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.851682  7857 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: loading cluster ID for follower catalog manager: success
23:48:27.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.856154  7857 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: acquiring CA information for follower catalog manager: success
23:48:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.856544  8001 heartbeater.cc:344] Connected to a master server at 127.7.104.125:36473
23:48:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.856964  8001 heartbeater.cc:461] Registering TS with master...
23:48:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.858106  8001 heartbeater.cc:507] Master 127.7.104.125:36473 requested a full tablet report, sending...
23:48:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.859053  8000 heartbeater.cc:344] Connected to a master server at 127.7.104.126:33577
23:48:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.859189  8000 heartbeater.cc:461] Registering TS with master...
23:48:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.859733  8000 heartbeater.cc:507] Master 127.7.104.126:33577 requested a full tablet report, sending...
23:48:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.862087  7703 ts_manager.cc:194] Registered new tserver with Master: 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995)
23:48:27.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.864288  7632 ts_manager.cc:194] Registered new tserver with Master: 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995)
23:48:27.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.865120  7857 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 784f2649e9544fbdbf6c74c739cb9e05: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:27.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.866466  7632 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.104.65:50703
23:48:27.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.871801  7999 heartbeater.cc:344] Connected to a master server at 127.7.104.124:39307
23:48:27.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.871973  7999 heartbeater.cc:461] Registering TS with master...
23:48:27.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.872359  7999 heartbeater.cc:507] Master 127.7.104.124:39307 requested a full tablet report, sending...
23:48:27.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:27.874529  7774 ts_manager.cc:194] Registered new tserver with Master: 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995)
23:48:27.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468107902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:27.913 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:27.914 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
23:48:27.978 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:27.979 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:27.979 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:27.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:27.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:27.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:27.980 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:27.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:27.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:27.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:27.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:27.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:27.980 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:28.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468108091 for job 6446e0085b210020482ce7a622d23630.
23:48:28.101 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:28.102 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
23:48:28.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.245945  8005 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:28.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.246284  8005 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:28.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.246369  8005 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:28.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:28.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.255302  8005 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:28.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.255549  8005 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.104.66
23:48:28.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.266446  8005 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:28.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:28.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.66:0
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data/info.pb
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.66
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.104.66
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/logs
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:28.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:28.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.268563  8005 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:28.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.270629  8005 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.282334  8014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:28.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.283143  8017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:28.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.283473  8015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:28.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.284459  8005 server_base.cc:1061] running on GCE node
23:48:28.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.285259  8005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:28.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.286445  8005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:28.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.287693  8005 hybrid_clock.cc:648] HybridClock initialized: now 1783468108287613 us; error 65 us; skew 500 ppm
23:48:28.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.288216  8005 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:28.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.291157  8005 webserver.cc:534] Webserver started at http://127.7.104.66:39309/ using document root <none> and password file <none>
23:48:28.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.292053  8005 fs_manager.cc:362] Metadata directory not provided
23:48:28.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.292161  8005 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:28.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.292484  8005 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:28.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.295197  8005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data/instance:
23:48:28.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:28.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:28 on dist-test-slave-hfsf"
23:48:28.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.296116  8005 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal/instance:
23:48:28.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:28.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:28 on dist-test-slave-hfsf"
23:48:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.302138  8005 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
23:48:28.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.306150  8023 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.307812  8005 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.308040  8005 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:28 on dist-test-slave-hfsf"
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.308302  8005 fs_report.cc:389] FS layout report
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data/data
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:28.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.342741  8005 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:28.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.343807  8005 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:28.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.344053  8005 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:28.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.345234  8005 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:28.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.347110  8005 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:28.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.347208  8005 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:28.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.347287  8005 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:28.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.347337  8005 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.388423  8005 rpc_server.cc:307] RPC server started. Bound to: 127.7.104.66:35629
23:48:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.388562  8135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.104.66:35629 every 8 connection(s)
23:48:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.390048  8005 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/data/info.pb
23:48:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.391253  7585 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8005
23:48:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.391486  7585 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-1/wal/instance
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.396266  7585 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/logs
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data/info.pb
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:28.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.67:0
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.104.67
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.67
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:28.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468108402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.417168  8136 heartbeater.cc:344] Connected to a master server at 127.7.104.124:39307
23:48:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.417656  8136 heartbeater.cc:461] Registering TS with master...
23:48:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.419010  8136 heartbeater.cc:507] Master 127.7.104.124:39307 requested a full tablet report, sending...
23:48:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.421732  8138 heartbeater.cc:344] Connected to a master server at 127.7.104.125:36473
23:48:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.421720  7774 ts_manager.cc:194] Registered new tserver with Master: aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.421871  8138 heartbeater.cc:461] Registering TS with master...
23:48:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.422492  8138 heartbeater.cc:507] Master 127.7.104.125:36473 requested a full tablet report, sending...
23:48:28.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.423732  7703 ts_manager.cc:194] Registered new tserver with Master: aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:28.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.425794  8137 heartbeater.cc:344] Connected to a master server at 127.7.104.126:33577
23:48:28.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.425957  8137 heartbeater.cc:461] Registering TS with master...
23:48:28.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.426517  8137 heartbeater.cc:507] Master 127.7.104.126:33577 requested a full tablet report, sending...
23:48:28.427 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
23:48:28.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.427835  7632 ts_manager.cc:194] Registered new tserver with Master: aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:28.429 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
23:48:28.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.429154  7632 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.104.66:43661
23:48:28.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468108591 for job 6446e0085b210020482ce7a622d23630.
23:48:28.607 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
23:48:28.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
23:48:28.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:28.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.815507  8146 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:28.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.815819  8146 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:28.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.815980  8146 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.824934  8146 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.825109  8146 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.104.67
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.835825  8146 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.104.84:41027
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.104.67:0
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data/info.pb
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.104.67
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.104.126:33577,127.7.104.125:36473,127.7.104.124:39307
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.104.67
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/logs
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:28.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:28.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.837581  8146 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:28.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.839567  8146 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:28.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.851240  8151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:28.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.851588  8152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:28.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:28.851617  8154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:28.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.853294  8146 server_base.cc:1061] running on GCE node
23:48:28.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.854010  8146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:28.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.855197  8146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:28.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.856473  8146 hybrid_clock.cc:648] HybridClock initialized: now 1783468108856421 us; error 41 us; skew 500 ppm
23:48:28.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.856788  8146 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.859351  8146 webserver.cc:534] Webserver started at http://127.7.104.67:36549/ using document root <none> and password file <none>
23:48:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.860235  8146 fs_manager.cc:362] Metadata directory not provided
23:48:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.860383  8146 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.860781  8146 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.863487  8146 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data/instance:
23:48:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:28 on dist-test-slave-hfsf"
23:48:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.864571  8146 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal/instance:
23:48:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:28 on dist-test-slave-hfsf"
23:48:28.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.870517  8000 heartbeater.cc:499] Master 127.7.104.126:33577 was elected leader, sending a full tablet report...
23:48:28.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.870975  8146 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
23:48:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.875734  8160 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.877836  8146 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.878010  8146 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:28 on dist-test-slave-hfsf"
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.878192  8146 fs_report.cc:389] FS layout report
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data/data
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:28.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:28.902 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468108902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:28.913 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:28.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
23:48:28.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.933161  8146 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.934203  8146 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.934549  8146 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.935810  8146 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:28.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.937805  8146 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:28.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.937903  8146 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:28.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.937979  8146 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:28.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.938025  8146 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.996909  8146 rpc_server.cc:307] RPC server started. Bound to: 127.7.104.67:35321
23:48:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.997141  8272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.104.67:35321 every 8 connection(s)
23:48:28.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:28.998792  8146 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/data/info.pb
23:48:29.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.007661  7585 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8146
23:48:29.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.007877  7585 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster14092013035185365946/ts-2/wal/instance
23:48:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.041080  8274 heartbeater.cc:344] Connected to a master server at 127.7.104.126:33577
23:48:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.041100  8275 heartbeater.cc:344] Connected to a master server at 127.7.104.125:36473
23:48:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.041594  8275 heartbeater.cc:461] Registering TS with master...
23:48:29.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.041594  8274 heartbeater.cc:461] Registering TS with master...
23:48:29.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.042908  8274 heartbeater.cc:507] Master 127.7.104.126:33577 requested a full tablet report, sending...
23:48:29.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.042908  8275 heartbeater.cc:507] Master 127.7.104.125:36473 requested a full tablet report, sending...
23:48:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.044932  7632 ts_manager.cc:194] Registered new tserver with Master: e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.046021  8273 heartbeater.cc:344] Connected to a master server at 127.7.104.124:39307
23:48:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.046053  7632 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.104.67:33627
23:48:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.046132  8273 heartbeater.cc:461] Registering TS with master...
23:48:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.046624  8273 heartbeater.cc:507] Master 127.7.104.124:39307 requested a full tablet report, sending...
23:48:29.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.048014  7773 ts_manager.cc:194] Registered new tserver with Master: e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:29.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.048545  7703 ts_manager.cc:194] Registered new tserver with Master: e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:29.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.064179  7585 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:29.066 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:29.066 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:29.068 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.7.104.126"
      port: 33577
    }
    bound_http_address {
      host: "127.7.104.126"
      port: 35013
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.7.104.125"
      port: 36473
    }
    bound_http_address {
      host: "127.7.104.125"
      port: 35287
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.7.104.124"
      port: 39307
    }
    bound_http_address {
      host: "127.7.104.124"
      port: 39117
    }
  }
}

23:48:29.068 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:29.069 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.7.104.65"
      port: 45995
    }
    bound_http_address {
      host: "127.7.104.65"
      port: 45597
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.7.104.66"
      port: 35629
    }
    bound_http_address {
      host: "127.7.104.66"
      port: 39309
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.7.104.67"
      port: 35321
    }
    bound_http_address {
      host: "127.7.104.67"
      port: 36549
    }
  }
}

23:48:29.069 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:29.071 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:29.071 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:48:29.071 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:48:29.071 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:48:29.071 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:48:29.075 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:48:29.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468109091 for job 6446e0085b210020482ce7a622d23630.
23:48:29.102 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:29.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
23:48:29.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:29.334 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:29.334 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:29.334 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:29.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.335 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.335 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.335 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.335 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:29.336 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:29.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:29.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:29.337 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.337 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.337 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.337 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.337 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.337 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.337 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:29.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468109402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:29.413 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:29.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
23:48:29.422 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:29.423 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:29.423 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:29.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:29.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:29.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:29.424 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:29.424 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:29.424 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:29.424 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:29.424 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:29.424 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:29.424 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:29.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.432345  8137 heartbeater.cc:499] Master 127.7.104.126:33577 was elected leader, sending a full tablet report...
23:48:29.502 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:29.502 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:48:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.504928  8283 mini_oidc.cc:150] Starting JWKS server
23:48:29.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.507664  8283 webserver.cc:534] Webserver started at http://127.0.0.1:43507/ using document root <none> and password file <none>
23:48:29.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.507993  8283 mini_oidc.cc:186] Starting OIDC Discovery server
23:48:29.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.508677  8283 webserver.cc:534] Webserver started at http://127.0.0.1:40869/ using document root <none> and password file <none>
23:48:29.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:48:29.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:29Z Disabled control of system clock
23:48:29.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.541668  8283 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:29.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:29.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/logs
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data/info.pb
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.254:45201
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.254
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:29.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43507/jwks.json with env {}
23:48:29.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468109591 for job 6446e0085b210020482ce7a622d23630.
23:48:29.620 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=28 ms, finalizationTime=1 ms).
23:48:29.621 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
23:48:29.622 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:29.622 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:29.622 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:29.623 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.623 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:29.623 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.623 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:29.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.624 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.624 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:29.624 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:29.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:29.803 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:29.803 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:29.804 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:29.804 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:29.804 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:29.804 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:29.804 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:29.804 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:29.804 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:29.804 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:29.804 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:29.804 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:29.804 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:29.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468109902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:29.915 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:29.916 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
23:48:29.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.975675  8294 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:29.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.976092  8294 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:29.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.976181  8294 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:29.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.985733  8294 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:29.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.985844  8294 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:29.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.985906  8294 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:29.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.985949  8294 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:29.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.986002  8294 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:29.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:29.986037  8294 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43507/jwks.json
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:29.997959  8294 master_runner.cc:387] Master server non-default flags:
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.254:45201
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43507/jwks.json
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data/info.pb
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.254
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:29.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/logs
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:29.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:30.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.000363  8294 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:30.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.003163  8294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:30.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.013284  8301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:30.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.013341  8300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:30.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.016460  8303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:30.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.016646  8294 server_base.cc:1061] running on GCE node
23:48:30.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.017688  8294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:30.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.019694  8294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:30.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.021047  8294 hybrid_clock.cc:648] HybridClock initialized: now 1783468110020952 us; error 96 us; skew 500 ppm
23:48:30.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.021461  8294 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:30.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.024338  8294 webserver.cc:534] Webserver started at http://127.8.22.254:36091/ using document root <none> and password file <none>
23:48:30.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.025292  8294 fs_manager.cc:362] Metadata directory not provided
23:48:30.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.025435  8294 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:30.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.025831  8294 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.028702  8294 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data/instance:
23:48:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b"
23:48:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:30 on dist-test-slave-hfsf"
23:48:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.029738  8294 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal/instance:
23:48:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b"
23:48:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:30 on dist-test-slave-hfsf"
23:48:30.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.036563  8294 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
23:48:30.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.041101  8309 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:30.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.043247  8294 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
23:48:30.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.043480  8294 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal
23:48:30.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b"
23:48:30.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:30 on dist-test-slave-hfsf"
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.043749  8294 fs_report.cc:389] FS layout report
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data/data
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:30.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.050091  8274 heartbeater.cc:499] Master 127.7.104.126:33577 was elected leader, sending a full tablet report...
23:48:30.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.080919  8294 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:30.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.082012  8294 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:30.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.082353  8294 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:30.091 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468110091 for job 6446e0085b210020482ce7a622d23630.
23:48:30.102 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:30.103 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
23:48:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.114200  8294 rpc_server.cc:307] RPC server started. Bound to: 127.8.22.254:45201
23:48:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.114249  8360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.22.254:45201 every 8 connection(s)
23:48:30.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.116190  8294 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/data/info.pb
23:48:30.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.121655  8283 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8294
23:48:30.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.122005  8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:30.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.122033  8283 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-0/wal/instance
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.124544  8283 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/logs
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data/info.pb
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.253:33181
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.253
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43507/jwks.json with env {}
23:48:30.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.130772  8361 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } has no permanent_uuid. Determining permanent_uuid...
23:48:30.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.154080  8361 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } has no permanent_uuid. Determining permanent_uuid...
23:48:30.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.155752  8312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.22.253:33181: connect: Connection refused (error 111)
23:48:30.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.158427  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.253:33181: Network error: Client connection negotiation failed: client connection to 127.8.22.253:33181: connect: Connection refused (error 111)
23:48:30.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.207849  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } attempt: 1
23:48:30.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.210404  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.253:33181: Network error: Client connection negotiation failed: client connection to 127.8.22.253:33181: connect: Connection refused (error 111)
23:48:30.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:30.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.278707  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } attempt: 2
23:48:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.281391  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.253:33181: Network error: Client connection negotiation failed: client connection to 127.8.22.253:33181: connect: Connection refused (error 111)
23:48:30.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.372701  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } attempt: 3
23:48:30.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.375349  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.253:33181: Network error: Client connection negotiation failed: client connection to 127.8.22.253:33181: connect: Connection refused (error 111)
23:48:30.393 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:30.394 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:30.394 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:30.394 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.394 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.395 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.395 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.395 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.395 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.395 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.395 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:30.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468110402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:30.414 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:30.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
23:48:30.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.518611  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } attempt: 4
23:48:30.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.520838  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.253:33181: Network error: Client connection negotiation failed: client connection to 127.8.22.253:33181: connect: Connection refused (error 111)
23:48:30.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.535926  8363 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:30.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.536419  8363 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:30.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.536559  8363 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.546166  8363 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.546314  8363 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.546406  8363 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.546466  8363 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.546550  8363 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.546608  8363 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43507/jwks.json
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.559245  8363 master_runner.cc:387] Master server non-default flags:
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:30.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.253:33181
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43507/jwks.json
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data/info.pb
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.253
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/logs
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:30.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:30.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.561400  8363 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:30.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.563781  8363 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:30.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.573956  8371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:30.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.573980  8372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:30.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.575942  8374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:30.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.576866  8363 server_base.cc:1061] running on GCE node
23:48:30.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.577864  8363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:30.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.579571  8363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:30.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.580859  8363 hybrid_clock.cc:648] HybridClock initialized: now 1783468110580736 us; error 128 us; skew 500 ppm
23:48:30.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.581355  8363 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:30.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.584565  8363 webserver.cc:534] Webserver started at http://127.8.22.253:37493/ using document root <none> and password file <none>
23:48:30.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.585556  8363 fs_manager.cc:362] Metadata directory not provided
23:48:30.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.585703  8363 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:30.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.586125  8363 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:30.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.589090  8363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data/instance:
23:48:30.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b4e4f34240354601a1aceb43de0380de"
23:48:30.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:30 on dist-test-slave-hfsf"
23:48:30.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.590065  8363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal/instance:
23:48:30.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b4e4f34240354601a1aceb43de0380de"
23:48:30.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:30 on dist-test-slave-hfsf"
23:48:30.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468110591 for job 6446e0085b210020482ce7a622d23630.
23:48:30.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.598217  8363 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
23:48:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.602903  8380 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:30.603 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:30.604 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.605020  8363 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.605197  8363 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b4e4f34240354601a1aceb43de0380de"
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:30 on dist-test-slave-hfsf"
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.605443  8363 fs_report.cc:389] FS layout report
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data/data
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:30.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.639863  8363 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:30.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.640911  8363 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:30.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.641285  8363 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.665686  8431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.22.253:33181 every 8 connection(s)
23:48:30.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.665700  8363 rpc_server.cc:307] RPC server started. Bound to: 127.8.22.253:33181
23:48:30.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.667714  8363 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/data/info.pb
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.669024  8283 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8363
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.669251  8283 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-1/wal/instance
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.670531  8283 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/logs
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data/info.pb
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:30.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.252:44235
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.252
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:30.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43507/jwks.json with env {}
23:48:30.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.673475  8432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:30.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.681252  8432 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } has no permanent_uuid. Determining permanent_uuid...
23:48:30.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.696398  8432 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } has no permanent_uuid. Determining permanent_uuid...
23:48:30.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.707052  8432 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } has no permanent_uuid. Determining permanent_uuid...
23:48:30.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.708384  8383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.710281  8432 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.759668  8432 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 1
23:48:30.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.762418  8432 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.799 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:30.800 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:30.800 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:30.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.800 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.800 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.800 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.801 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:30.819 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:30.819 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:30.819 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:30.819 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:30.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:30.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:30.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.820421  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } attempt: 5
23:48:30.820 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:30.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.827567  8361 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } has no permanent_uuid. Determining permanent_uuid...
23:48:30.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.829604  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.830691  8432 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 2
23:48:30.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.832683  8432 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.880851  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 1
23:48:30.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.883386  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468110902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:30.914 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:30.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
23:48:30.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.923920  8432 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 3
23:48:30.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.926447  8432 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:30.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:30.951668  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 2
23:48:30.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:30.954074  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:31.036 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:31.036 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:31.037 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:31.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:31.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:31.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:31.037 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:31.037 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:31.037 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:31.037 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:31.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:31.037 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:31.037 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:31.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.060322  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 3
23:48:31.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.062995  8361 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:31.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.069707  8432 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 4
23:48:31.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.071981  8432 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.22.252:44235: Network error: Client connection negotiation failed: client connection to 127.8.22.252:44235: connect: Connection refused (error 111)
23:48:31.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468111091 for job 6446e0085b210020482ce7a622d23630.
23:48:31.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.102612  8434 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:31.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.103158  8434 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:31.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.103319  8434 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:31.103 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:31.104 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
23:48:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.115063  8434 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.115202  8434 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.115285  8434 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.115345  8434 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.115427  8434 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.115477  8434 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43507/jwks.json
23:48:31.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.131470  8434 master_runner.cc:387] Master server non-default flags:
23:48:31.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:31.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:31.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:31.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.252:44235
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43507/jwks.json
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data/info.pb
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.252
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/logs
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:31.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.133380  8434 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:31.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.135775  8434 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.146070  8444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.146060  8443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:31.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.149832  8434 server_base.cc:1061] running on GCE node
23:48:31.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.151166  8446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:31.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.152412  8434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:31.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.154114  8434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:31.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.155392  8434 hybrid_clock.cc:648] HybridClock initialized: now 1783468111155347 us; error 52 us; skew 500 ppm
23:48:31.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.155788  8434 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:31.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.158869  8434 webserver.cc:534] Webserver started at http://127.8.22.252:45227/ using document root <none> and password file <none>
23:48:31.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.159672  8434 fs_manager.cc:362] Metadata directory not provided
23:48:31.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.159770  8434 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:31.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.160146  8434 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.162778  8434 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data/instance:
23:48:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b870a640edce46c4aa732d8389b94377"
23:48:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:31 on dist-test-slave-hfsf"
23:48:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.163761  8434 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal/instance:
23:48:31.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b870a640edce46c4aa732d8389b94377"
23:48:31.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:31 on dist-test-slave-hfsf"
23:48:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.170150  8434 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
23:48:31.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.174587  8452 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:31.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.176463  8434 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:31.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.176707  8434 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b870a640edce46c4aa732d8389b94377"
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:31 on dist-test-slave-hfsf"
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.177044  8434 fs_report.cc:389] FS layout report
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data/data
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:31.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:31.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.211495  8434 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:31.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.212536  8434 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:31.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.212812  8434 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:31.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.237864  8434 rpc_server.cc:307] RPC server started. Bound to: 127.8.22.252:44235
23:48:31.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.237892  8503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.22.252:44235 every 8 connection(s)
23:48:31.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.239780  8434 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/data/info.pb
23:48:31.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.240285  8361 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 4
23:48:31.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.242293  8283 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8434
23:48:31.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.242544  8283 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/master-2/wal/instance
23:48:31.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:31.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.249104  8504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:31.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.261940  8504 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } has no permanent_uuid. Determining permanent_uuid...
23:48:31.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.271996  8361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: Bootstrap starting.
23:48:31.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.278398  8361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: Neither blocks nor log segments found. Creating new log.
23:48:31.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.278357  8504 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } has no permanent_uuid. Determining permanent_uuid...
23:48:31.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.280511  8361 log.cc:826] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: Log is configured to *not* fsync() on all Append() calls
23:48:31.282 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:31.283 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:31.283 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:31.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:31.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:31.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:31.285 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:31.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:31.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:31.285 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:31.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:31.285 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:31.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:31.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.290467  8361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: No bootstrap required, opened a new log
23:48:31.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.299851  8504 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } has no permanent_uuid. Determining permanent_uuid...
23:48:31.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.301637  8361 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.301941  8361 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:31.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.302028  8361 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3203e7cc5f4e09aa21dbe0b8f7958b, State: Initialized, Role: FOLLOWER
23:48:31.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.302671  8361 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.303779  8513 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.304131  8513 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.305124  8361 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: configured and running, proceeding with master startup.
23:48:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.313613  8504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: Bootstrap starting.
23:48:31.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.318109  8504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: Neither blocks nor log segments found. Creating new log.
23:48:31.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.319640  8504 log.cc:826] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: Log is configured to *not* fsync() on all Append() calls
23:48:31.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.323349  8524 catalog_manager.cc:1593] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:31.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.323506  8524 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:31.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.327062  8504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: No bootstrap required, opened a new log
23:48:31.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.323030  8294 master_runner.cc:187] Error getting master registration for 127.8.22.253:33181: OK, instance_id { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" instance_seqno: 1783468110659179 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:31.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.330024  8294 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.336524  8315 tablet.cc:2406] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.336434  8504 raft_consensus.cc:359] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.336889  8504 raft_consensus.cc:385] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.337031  8504 raft_consensus.cc:740] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b870a640edce46c4aa732d8389b94377, State: Initialized, Role: FOLLOWER
23:48:31.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.337952  8504 consensus_queue.cc:260] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.339282  8527 sys_catalog.cc:455] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.339810  8527 sys_catalog.cc:458] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.341029  8504 sys_catalog.cc:565] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: configured and running, proceeding with master startup.
23:48:31.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.359552  8538 catalog_manager.cc:1593] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:31.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.360040  8538 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:31.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.359588  8434 master_runner.cc:187] Error getting master registration for 127.8.22.253:33181: OK, instance_id { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" instance_seqno: 1783468110659179 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:31.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.367816  8434 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:31.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.371260  8432 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } attempt: 5
23:48:31.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.386442  8432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: Bootstrap starting.
23:48:31.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.391348  8432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: Neither blocks nor log segments found. Creating new log.
23:48:31.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.394665  8432 log.cc:826] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: Log is configured to *not* fsync() on all Append() calls
23:48:31.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.398428  8432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: No bootstrap required, opened a new log
23:48:31.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468111402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.406921  8432 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.407557  8432 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.407829  8432 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4e4f34240354601a1aceb43de0380de, State: Initialized, Role: FOLLOWER
23:48:31.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.408763  8432 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.409843  8541 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.410293  8541 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.411377  8432 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: configured and running, proceeding with master startup.
23:48:31.414 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:31.417 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
23:48:31.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.446343  8363 master_runner.cc:264] No leader master found from master b4e4f34240354601a1aceb43de0380de
23:48:31.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.446508  8363 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:31.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.452965  8552 catalog_manager.cc:1593] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:31.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.453151  8552 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:31.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.465544  8458 tablet.cc:2406] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:31.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.551862  8527 raft_consensus.cc:493] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:31.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.552187  8527 raft_consensus.cc:515] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.554225  8527 leader_election.cc:290] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc3203e7cc5f4e09aa21dbe0b8f7958b (127.8.22.254:45201), b4e4f34240354601a1aceb43de0380de (127.8.22.253:33181)
23:48:31.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.555599  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b870a640edce46c4aa732d8389b94377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" is_pre_election: true
23:48:31.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.556185  8336 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b870a640edce46c4aa732d8389b94377 in term 0.
23:48:31.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.558038  8407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b870a640edce46c4aa732d8389b94377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4e4f34240354601a1aceb43de0380de" is_pre_election: true
23:48:31.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.559861  8453 leader_election.cc:304] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b870a640edce46c4aa732d8389b94377, fc3203e7cc5f4e09aa21dbe0b8f7958b; no voters: 
23:48:31.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.558745  8407 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b870a640edce46c4aa732d8389b94377 in term 0.
23:48:31.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.562160  8527 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:31.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.562373  8527 raft_consensus.cc:493] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:31.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.562479  8527 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 0 FOLLOWER]: Advancing to term 1
23:48:31.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.566854  8527 raft_consensus.cc:515] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.575623  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b870a640edce46c4aa732d8389b94377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b"
23:48:31.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.576337  8336 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 0 FOLLOWER]: Advancing to term 1
23:48:31.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.580417  8336 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b870a640edce46c4aa732d8389b94377 in term 1.
23:48:31.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.581286  8453 leader_election.cc:304] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b870a640edce46c4aa732d8389b94377, fc3203e7cc5f4e09aa21dbe0b8f7958b; no voters: 
23:48:31.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.586531  8407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b870a640edce46c4aa732d8389b94377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4e4f34240354601a1aceb43de0380de"
23:48:31.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.587100  8407 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 0 FOLLOWER]: Advancing to term 1
23:48:31.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.591789  8407 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b870a640edce46c4aa732d8389b94377 in term 1.
23:48:31.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468111591 for job 6446e0085b210020482ce7a622d23630.
23:48:31.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.593017  8527 leader_election.cc:290] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [CANDIDATE]: Term 1 election: Requested vote from peers fc3203e7cc5f4e09aa21dbe0b8f7958b (127.8.22.254:45201), b4e4f34240354601a1aceb43de0380de (127.8.22.253:33181)
23:48:31.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.599020  8527 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 1 FOLLOWER]: Leader election won for term 1
23:48:31.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.600030  8527 raft_consensus.cc:697] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [term 1 LEADER]: Becoming Leader. State: Replica: b870a640edce46c4aa732d8389b94377, State: Running, Role: LEADER
23:48:31.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.600972  8527 consensus_queue.cc:237] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } }
23:48:31.603 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:31.605 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
23:48:31.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.614929  8554 sys_catalog.cc:455] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b870a640edce46c4aa732d8389b94377. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.615657  8554 sys_catalog.cc:458] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: This master's current role is: LEADER
23:48:31.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.627524  8556 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:48:31.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.630556  8556 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:48:31.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:31.644586  8386 tablet.cc:2406] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:31.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.653425  8407 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [term 1 FOLLOWER]: Refusing update from remote peer b870a640edce46c4aa732d8389b94377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:31.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.654970  8554 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:31.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.657945  8336 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [term 1 FOLLOWER]: Refusing update from remote peer b870a640edce46c4aa732d8389b94377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:31.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.659560  8527 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:31.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.723050  8541 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: SysCatalogTable state changed. Reason: New leader b870a640edce46c4aa732d8389b94377. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.723417  8541 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.738792  8541 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.739095  8541 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.744391  8513 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b870a640edce46c4aa732d8389b94377. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.744714  8513 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.747629  8559 mvcc.cc:204] Tried to move back new op lower bound from 7305085385319411712 to 7305085385134141440. Current Snapshot: MvccSnapshot[applied={T|T < 7305085385319411712 or (T in {7305085385319411712})}]
23:48:31.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:31.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.752909  8554 sys_catalog.cc:455] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.753436  8554 sys_catalog.cc:458] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: This master's current role is: LEADER
23:48:31.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.755064  8556 catalog_manager.cc:1382] Generated new cluster ID: 919c3bcf70e54471baca4429738dab76
23:48:31.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.755205  8556 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:48:31.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.770498  8558 mvcc.cc:204] Tried to move back new op lower bound from 7305085385319411712 to 7305085385134141440. Current Snapshot: MvccSnapshot[applied={T|T < 7305085385319411712}]
23:48:31.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.772783  8527 sys_catalog.cc:455] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.774654  8527 sys_catalog.cc:458] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377 [sys.catalog]: This master's current role is: LEADER
23:48:31.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.777216  8513 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b870a640edce46c4aa732d8389b94377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3203e7cc5f4e09aa21dbe0b8f7958b" member_type: VOTER last_known_addr { host: "127.8.22.254" port: 45201 } } peers { permanent_uuid: "b4e4f34240354601a1aceb43de0380de" member_type: VOTER last_known_addr { host: "127.8.22.253" port: 33181 } } peers { permanent_uuid: "b870a640edce46c4aa732d8389b94377" member_type: VOTER last_known_addr { host: "127.8.22.252" port: 44235 } } }
23:48:31.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.777451  8513 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b [sys.catalog]: This master's current role is: FOLLOWER
23:48:31.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.847177  8556 catalog_manager.cc:1405] Generated new certificate authority record
23:48:31.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.849287  8556 catalog_manager.cc:1539] Loading token signing keys...
23:48:31.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.872241  8556 catalog_manager.cc:6069] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: Generated new TSK 0
23:48:31.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.873934  8556 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:48:31.902 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468111902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:31.910357  8283 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/logs
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data/info.pb
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.193:0
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.8.22.193
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.193
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:31.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:31.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:31.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:31.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:31.921 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
23:48:31.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
23:48:32.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468112091 for job 6446e0085b210020482ce7a622d23630.
23:48:32.102 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:32.107 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
23:48:32.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:32.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.325645  8524 catalog_manager.cc:1294] Loaded cluster ID: 919c3bcf70e54471baca4429738dab76
23:48:32.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.325781  8524 catalog_manager.cc:1587] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: loading cluster ID for follower catalog manager: success
23:48:32.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.328974  8524 catalog_manager.cc:1609] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: acquiring CA information for follower catalog manager: success
23:48:32.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.331179  8524 catalog_manager.cc:1637] T 00000000000000000000000000000000 P fc3203e7cc5f4e09aa21dbe0b8f7958b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:32.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.368113  8566 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:32.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.368603  8566 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:32.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.368714  8566 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:32.375 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:32.376 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:32.376 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:32.376 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:32.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:32.377 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:32.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:32.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:32.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:32.377 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:32.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:32.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:32.377 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:32.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.378441  8566 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:32.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.378623  8566 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.22.193
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.390043  8566 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.193:0
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data/info.pb
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.193
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.8.22.193
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/logs
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:32.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:32.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:32.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.392108  8566 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:32.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.394089  8566 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:32.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468112402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:32.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.406364  8572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:32.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.409482  8574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:32.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.410140  8571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:32.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.410740  8566 server_base.cc:1061] running on GCE node
23:48:32.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.411685  8566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:32.413 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:32.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
23:48:32.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.413136  8566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:32.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.414721  8566 hybrid_clock.cc:648] HybridClock initialized: now 1783468112414646 us; error 53 us; skew 500 ppm
23:48:32.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.415126  8566 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:32.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.417748  8566 webserver.cc:534] Webserver started at http://127.8.22.193:43413/ using document root <none> and password file <none>
23:48:32.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.418577  8566 fs_manager.cc:362] Metadata directory not provided
23:48:32.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.418684  8566 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:32.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.419203  8566 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:32.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.422024  8566 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data/instance:
23:48:32.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2100c738f2f94e4884d53e49614df1c4"
23:48:32.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:32 on dist-test-slave-hfsf"
23:48:32.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.422950  8566 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal/instance:
23:48:32.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2100c738f2f94e4884d53e49614df1c4"
23:48:32.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:32 on dist-test-slave-hfsf"
23:48:32.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.429070  8566 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:48:32.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.433727  8580 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.435703  8566 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.436030  8566 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2100c738f2f94e4884d53e49614df1c4"
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:32 on dist-test-slave-hfsf"
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.436318  8566 fs_report.cc:389] FS layout report
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data/data
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:32.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.455636  8552 catalog_manager.cc:1294] Loaded cluster ID: 919c3bcf70e54471baca4429738dab76
23:48:32.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.455750  8552 catalog_manager.cc:1587] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: loading cluster ID for follower catalog manager: success
23:48:32.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.457490  8566 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:32.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.458673  8566 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:32.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.459017  8566 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:32.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.459713  8552 catalog_manager.cc:1609] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: acquiring CA information for follower catalog manager: success
23:48:32.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.462073  8566 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:32.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.462898  8552 catalog_manager.cc:1637] T 00000000000000000000000000000000 P b4e4f34240354601a1aceb43de0380de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:32.463 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:32.463 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:32.463 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:32.464 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:32.464 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:32.464 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:32.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:32.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:32.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:32.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:32.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:32.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:32.464 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:32.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.465185  8566 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:32.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.465296  8566 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:32.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.465389  8566 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:32.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.465446  8566 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:32.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.512218  8566 rpc_server.cc:307] RPC server started. Bound to: 127.8.22.193:34899
23:48:32.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.512559  8692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.22.193:34899 every 8 connection(s)
23:48:32.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.513891  8566 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/data/info.pb
23:48:32.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.521648  8283 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8566
23:48:32.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.521950  8283 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-0/wal/instance
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.529289  8283 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/logs
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data/info.pb
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:32.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.194:0
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.8.22.194
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.194
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:32.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.546066  8695 heartbeater.cc:344] Connected to a master server at 127.8.22.253:33181
23:48:32.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.546594  8695 heartbeater.cc:461] Registering TS with master...
23:48:32.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.547339  8694 heartbeater.cc:344] Connected to a master server at 127.8.22.254:45201
23:48:32.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.547644  8694 heartbeater.cc:461] Registering TS with master...
23:48:32.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.548058  8695 heartbeater.cc:507] Master 127.8.22.253:33181 requested a full tablet report, sending...
23:48:32.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.548537  8694 heartbeater.cc:507] Master 127.8.22.254:45201 requested a full tablet report, sending...
23:48:32.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.551512  8325 ts_manager.cc:194] Registered new tserver with Master: 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899)
23:48:32.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.552263  8396 ts_manager.cc:194] Registered new tserver with Master: 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899)
23:48:32.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.554484  8693 heartbeater.cc:344] Connected to a master server at 127.8.22.252:44235
23:48:32.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.554677  8693 heartbeater.cc:461] Registering TS with master...
23:48:32.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.555243  8693 heartbeater.cc:507] Master 127.8.22.252:44235 requested a full tablet report, sending...
23:48:32.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.558179  8469 ts_manager.cc:194] Registered new tserver with Master: 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899)
23:48:32.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.560935  8469 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.22.193:35517
23:48:32.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468112591 for job 6446e0085b210020482ce7a622d23630.
23:48:32.602 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:32.602 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
23:48:32.735 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:32.736 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:32.736 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:32.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:32.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:32.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:32.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:32.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:32.736 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:32.736 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:32.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:32.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:32.737 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:32.743 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:32.744 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:32.744 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:32.744 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:32.744 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:32.744 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:32.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:32.745 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:32.745 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:32.745 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:32.745 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:32.745 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:32.745 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:32.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:32.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468112902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:32.911 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:32.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
23:48:32.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.934340  8703 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:32.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.934849  8703 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:32.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.934969  8703 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:32.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.944916  8703 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:32.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.945106  8703 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.22.194
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.956468  8703 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.194:0
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:32.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data/info.pb
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.194
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.8.22.194
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/logs
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:32.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.958254  8703 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:32.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.960290  8703 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:32.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.971505  8709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:32.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.971529  8708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:32.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:32.972961  8711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:32.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.973696  8703 server_base.cc:1061] running on GCE node
23:48:32.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.974411  8703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:32.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.975626  8703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:32.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.976933  8703 hybrid_clock.cc:648] HybridClock initialized: now 1783468112976857 us; error 61 us; skew 500 ppm
23:48:32.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.977267  8703 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:32.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.979984  8703 webserver.cc:534] Webserver started at http://127.8.22.194:45969/ using document root <none> and password file <none>
23:48:32.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.980868  8703 fs_manager.cc:362] Metadata directory not provided
23:48:32.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.981014  8703 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:32.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.981417  8703 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.984591  8703 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data/instance:
23:48:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "183b79dc80df4a9583cef13752304681"
23:48:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:32 on dist-test-slave-hfsf"
23:48:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.985545  8703 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal/instance:
23:48:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "183b79dc80df4a9583cef13752304681"
23:48:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:32 on dist-test-slave-hfsf"
23:48:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.992126  8703 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
23:48:32.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.996059  8717 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:32.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.997725  8703 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.997949  8703 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "183b79dc80df4a9583cef13752304681"
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:32 on dist-test-slave-hfsf"
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:32.998220  8703 fs_report.cc:389] FS layout report
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data/data
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:32.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:33.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.021749  8703 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:33.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.022763  8703 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:33.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.023281  8703 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:33.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.024477  8703 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:33.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.026360  8703 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:33.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.026504  8703 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:33.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.026613  8703 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:33.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.026726  8703 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:33.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.066473  8703 rpc_server.cc:307] RPC server started. Bound to: 127.8.22.194:33843
23:48:33.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.066565  8829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.22.194:33843 every 8 connection(s)
23:48:33.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.068133  8703 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/data/info.pb
23:48:33.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.070569  8283 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8703
23:48:33.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.070835  8283 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-1/wal/instance
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.080199  8283 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/logs
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data/info.pb
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:33.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.195:0
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.8.22.195
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.195
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:33.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:33.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468113091 for job 6446e0085b210020482ce7a622d23630.
23:48:33.104 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:48:33.106 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
23:48:33.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.119760  8831 heartbeater.cc:344] Connected to a master server at 127.8.22.254:45201
23:48:33.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.120217  8831 heartbeater.cc:461] Registering TS with master...
23:48:33.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.121500  8831 heartbeater.cc:507] Master 127.8.22.254:45201 requested a full tablet report, sending...
23:48:33.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.122182  8830 heartbeater.cc:344] Connected to a master server at 127.8.22.252:44235
23:48:33.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.122323  8830 heartbeater.cc:461] Registering TS with master...
23:48:33.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.122843  8830 heartbeater.cc:507] Master 127.8.22.252:44235 requested a full tablet report, sending...
23:48:33.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.123450  8325 ts_manager.cc:194] Registered new tserver with Master: 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:33.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.123811  8469 ts_manager.cc:194] Registered new tserver with Master: 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:33.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.124881  8469 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.22.194:43943
23:48:33.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.134397  8832 heartbeater.cc:344] Connected to a master server at 127.8.22.253:33181
23:48:33.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.134619  8832 heartbeater.cc:461] Registering TS with master...
23:48:33.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.135085  8832 heartbeater.cc:507] Master 127.8.22.253:33181 requested a full tablet report, sending...
23:48:33.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.136355  8396 ts_manager.cc:194] Registered new tserver with Master: 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:33.157 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:33.157 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:33.157 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:33.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.158 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.158 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.158 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.159 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:33.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:33.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468113402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:33.412 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:33.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
23:48:33.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.488611  8837 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:33.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.489295  8837 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:33.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.489499  8837 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:33.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.499254  8837 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:33.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.499507  8837 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.22.195
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.510891  8837 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.8.22.212:37471
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.8.22.195:0
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data/info.pb
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.8.22.195
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.8.22.254:45201,127.8.22.253:33181,127.8.22.252:44235
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.8.22.195
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/logs
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:33.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.512997  8837 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:33.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.515219  8837 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:33.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.525774  8846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:33.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.525815  8847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:33.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.526563  8849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:33.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.527654  8837 server_base.cc:1061] running on GCE node
23:48:33.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.528378  8837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:33.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.529485  8837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:33.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.530757  8837 hybrid_clock.cc:648] HybridClock initialized: now 1783468113530678 us; error 71 us; skew 500 ppm
23:48:33.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.531365  8837 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:33.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.534214  8837 webserver.cc:534] Webserver started at http://127.8.22.195:40813/ using document root <none> and password file <none>
23:48:33.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.535122  8837 fs_manager.cc:362] Metadata directory not provided
23:48:33.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.535252  8837 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:33.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.535610  8837 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:33.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.538118  8837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data/instance:
23:48:33.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:33.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:33 on dist-test-slave-hfsf"
23:48:33.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.539067  8837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal/instance:
23:48:33.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:33.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:33 on dist-test-slave-hfsf"
23:48:33.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.545248  8837 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:48:33.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.549342  8855 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.551115  8837 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.551273  8837 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:33 on dist-test-slave-hfsf"
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.551473  8837 fs_report.cc:389] FS layout report
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data/data
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:33.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.564298  8693 heartbeater.cc:499] Master 127.8.22.252:44235 was elected leader, sending a full tablet report...
23:48:33.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.571497  8837 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:33.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.572469  8837 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:33.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.572721  8837 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:33.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.573890  8837 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:33.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.575872  8837 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:33.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.575991  8837 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:33.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.576071  8837 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:33.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.576160  8837 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:33.577 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:33.578 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:33.578 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:33.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.579 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.579 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.579 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.579 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.579 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.579 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.579 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.579 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.579 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:33.591 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468113591 for job 6446e0085b210020482ce7a622d23630.
23:48:33.600 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:33.601 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
23:48:33.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.635993  8837 rpc_server.cc:307] RPC server started. Bound to: 127.8.22.195:42601
23:48:33.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.636099  8967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.22.195:42601 every 8 connection(s)
23:48:33.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.637506  8837 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/data/info.pb
23:48:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.647039  8283 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 8837
23:48:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.647254  8283 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster13010720417207437028/ts-2/wal/instance
23:48:33.662 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:33.663 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:33.663 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.663 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.663 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:33.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.664 [INFO - pool-74-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:33.664 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:33.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:33.665 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:33.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.681136  8970 heartbeater.cc:344] Connected to a master server at 127.8.22.253:33181
23:48:33.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.681668  8970 heartbeater.cc:461] Registering TS with master...
23:48:33.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.682905  8970 heartbeater.cc:507] Master 127.8.22.253:33181 requested a full tablet report, sending...
23:48:33.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.684986  8396 ts_manager.cc:194] Registered new tserver with Master: 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:33.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.686758  8969 heartbeater.cc:344] Connected to a master server at 127.8.22.254:45201
23:48:33.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.686956  8969 heartbeater.cc:461] Registering TS with master...
23:48:33.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.687533  8969 heartbeater.cc:507] Master 127.8.22.254:45201 requested a full tablet report, sending...
23:48:33.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.687888  8968 heartbeater.cc:344] Connected to a master server at 127.8.22.252:44235
23:48:33.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.688020  8968 heartbeater.cc:461] Registering TS with master...
23:48:33.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.688482  8968 heartbeater.cc:507] Master 127.8.22.252:44235 requested a full tablet report, sending...
23:48:33.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.688797  8325 ts_manager.cc:194] Registered new tserver with Master: 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:33.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.689684  8469 ts_manager.cc:194] Registered new tserver with Master: 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:33.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.690522  8469 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.22.195:58643
23:48:33.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.695878  8283 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:33.697 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:33.698 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:33.699 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.8.22.254"
      port: 45201
    }
    bound_http_address {
      host: "127.8.22.254"
      port: 36091
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.8.22.253"
      port: 33181
    }
    bound_http_address {
      host: "127.8.22.253"
      port: 37493
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.8.22.252"
      port: 44235
    }
    bound_http_address {
      host: "127.8.22.252"
      port: 45227
    }
  }
}

23:48:33.699 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:33.700 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.8.22.193"
      port: 34899
    }
    bound_http_address {
      host: "127.8.22.193"
      port: 43413
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.8.22.194"
      port: 33843
    }
    bound_http_address {
      host: "127.8.22.194"
      port: 45969
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.8.22.195"
      port: 42601
    }
    bound_http_address {
      host: "127.8.22.195"
      port: 40813
    }
  }
}

23:48:33.700 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:33.702 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:33.703 [DEBUG - main] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:33.704 [DEBUG - main] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:33.704 [DEBUG - main] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:33.705 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.104.125:36473(127.7.104.125:36473)] Successfully connected to peer
23:48:33.705 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.104.126:33577(127.7.104.126:33577)] Successfully connected to peer
23:48:33.706 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.104.124:39307(127.7.104.124:39307)] Successfully connected to peer
23:48:33.708 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.124
23:48:33.717 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:33.719 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9f3b5e16, L:/127.0.0.1:34536 - R:/127.7.104.124:39307] using SASL/PLAIN
23:48:33.722 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.126
23:48:33.722 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.125
23:48:33.731 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:33.731 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:33.734 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcb1892fc, L:/127.0.0.1:45986 - R:/127.7.104.126:33577] using SASL/PLAIN
23:48:33.737 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:33.737 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=34), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [18ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: OK, [33ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: OK, deferred=null) after lookup
23:48:33.739 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x548f69f5, L:/127.0.0.1:60958 - R:/127.7.104.125:36473] using SASL/PLAIN
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.739195  7632 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45986:
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\0012\000\000\000\004\001\226\000\000\000"
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:33.742363  7632 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:33.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:33.776 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.833604  8071 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
23:48:33.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.833956  8069 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd39db2759a4265b52a1bcd82c9b355 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
23:48:33.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.832850  8066 tablet_service.cc:1511] Processing CreateTablet for tablet 50339fc54f264099966359f5cbc63947 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
23:48:33.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.835202  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50339fc54f264099966359f5cbc63947. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.836404  8071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.837368  8069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd39db2759a4265b52a1bcd82c9b355. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.838173  8067 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7473c87ce1473fab3709d68c863dcd (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.838652  8067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7473c87ce1473fab3709d68c863dcd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.839399  8068 tablet_service.cc:1511] Processing CreateTablet for tablet 4238b4248ecd495d9d7fe29bf37abc0b (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
23:48:33.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.839848  8068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4238b4248ecd495d9d7fe29bf37abc0b. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.832573  8070 tablet_service.cc:1511] Processing CreateTablet for tablet f4f3a8a917ec4959bafa5da9932eb932 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:33.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.840982  8070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f3a8a917ec4959bafa5da9932eb932. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.843657  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
23:48:33.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.842696  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 4238b4248ecd495d9d7fe29bf37abc0b (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
23:48:33.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.843127  8204 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7473c87ce1473fab3709d68c863dcd (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:33.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.844921  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.843250  8207 tablet_service.cc:1511] Processing CreateTablet for tablet f4f3a8a917ec4959bafa5da9932eb932 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:33.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.849748  7934 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
23:48:33.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.849634  7930 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7473c87ce1473fab3709d68c863dcd (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:33.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.849574  7933 tablet_service.cc:1511] Processing CreateTablet for tablet f4f3a8a917ec4959bafa5da9932eb932 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:33.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.851948  7934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.852396  7933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f3a8a917ec4959bafa5da9932eb932. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.853685  7931 tablet_service.cc:1511] Processing CreateTablet for tablet 4238b4248ecd495d9d7fe29bf37abc0b (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
23:48:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.854230  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4238b4248ecd495d9d7fe29bf37abc0b. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.855477  7929 tablet_service.cc:1511] Processing CreateTablet for tablet 50339fc54f264099966359f5cbc63947 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
23:48:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.856024  7929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50339fc54f264099966359f5cbc63947. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.863246  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7473c87ce1473fab3709d68c863dcd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.867156  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f3a8a917ec4959bafa5da9932eb932. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.873813  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4238b4248ecd495d9d7fe29bf37abc0b. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.875291  7930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7473c87ce1473fab3709d68c863dcd. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.878566  8999 tablet_bootstrap.cc:492] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28: Bootstrap starting.
23:48:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.879110  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd39db2759a4265b52a1bcd82c9b355 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
23:48:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.879168  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 50339fc54f264099966359f5cbc63947 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
23:48:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.879763  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd39db2759a4265b52a1bcd82c9b355. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.880065  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50339fc54f264099966359f5cbc63947. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.881481  7932 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd39db2759a4265b52a1bcd82c9b355 (DEFAULT_TABLE table=replication_test_table [id=95fd4697a05144e59514710ebcacd16c]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
23:48:33.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.883507  8999 tablet_bootstrap.cc:654] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28: Neither blocks nor log segments found. Creating new log.
23:48:33.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.899735  8999 log.cc:826] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28: Log is configured to *not* fsync() on all Append() calls
23:48:33.907 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468113903 for job 6b15b774f375318429e8c166741c1d9d.
23:48:33.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.905680  9000 tablet_bootstrap.cc:492] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: Bootstrap starting.
23:48:33.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.908959  8999 tablet_bootstrap.cc:492] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28: No bootstrap required, opened a new log
23:48:33.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.909297  8999 ts_tablet_manager.cc:1403] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
23:48:33.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.919427  9000 tablet_bootstrap.cc:654] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: Neither blocks nor log segments found. Creating new log.
23:48:33.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.919384  8999 raft_consensus.cc:359] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:33.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.919966  8999 raft_consensus.cc:385] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:33.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.920068  8999 raft_consensus.cc:740] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Initialized, Role: FOLLOWER
23:48:33.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.920873  9000 log.cc:826] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: Log is configured to *not* fsync() on all Append() calls
23:48:33.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.920869  8999 consensus_queue.cc:260] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:33.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.930902  8999 ts_tablet_manager.cc:1434] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.007s
23:48:33.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.938418  7932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd39db2759a4265b52a1bcd82c9b355. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:33.940 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=36 ms, finalizationTime=1 ms).
23:48:33.961 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
23:48:33.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.973803  9000 tablet_bootstrap.cc:492] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: No bootstrap required, opened a new log
23:48:33.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.974195  9000 ts_tablet_manager.cc:1403] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.032s
23:48:33.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.980430  8999 tablet_bootstrap.cc:492] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28: Bootstrap starting.
23:48:33.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.982637  8999 tablet_bootstrap.cc:654] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28: Neither blocks nor log segments found. Creating new log.
23:48:33.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.986429  9004 tablet_bootstrap.cc:492] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d: Bootstrap starting.
23:48:33.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.990671  9004 tablet_bootstrap.cc:654] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d: Neither blocks nor log segments found. Creating new log.
23:48:33.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.992955  9004 log.cc:826] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d: Log is configured to *not* fsync() on all Append() calls
23:48:33.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.993666  9000 raft_consensus.cc:359] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:33.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.994294  9000 raft_consensus.cc:385] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:33.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.994438  9000 raft_consensus.cc:740] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Initialized, Role: FOLLOWER
23:48:33.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.995500  9000 consensus_queue.cc:260] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:33.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.996690  9004 tablet_bootstrap.cc:492] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d: No bootstrap required, opened a new log
23:48:33.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.997262  9004 ts_tablet_manager.cc:1403] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.002s
23:48:33.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.998119  9000 ts_tablet_manager.cc:1434] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.002s
23:48:33.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:33.998592  9000 tablet_bootstrap.cc:492] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02: Bootstrap starting.
23:48:34.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.000567  9000 tablet_bootstrap.cc:654] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02: Neither blocks nor log segments found. Creating new log.
23:48:34.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.003082  9003 raft_consensus.cc:493] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.003355  9003 raft_consensus.cc:515] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.005640  9003 leader_election.cc:290] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.007539  9004 raft_consensus.cc:359] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.008174  9004 raft_consensus.cc:385] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.008446  9004 raft_consensus.cc:740] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Initialized, Role: FOLLOWER
23:48:34.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.009697  9004 consensus_queue.cc:260] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.012177  8999 tablet_bootstrap.cc:492] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28: No bootstrap required, opened a new log
23:48:34.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.012424  8999 ts_tablet_manager.cc:1403] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.007s
23:48:34.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.014219  8999 raft_consensus.cc:359] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.014510  8999 raft_consensus.cc:385] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.014655  8999 raft_consensus.cc:740] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Initialized, Role: FOLLOWER
23:48:34.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.015026  8999 consensus_queue.cc:260] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.025939  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6ef6227b04bf7b893c2f8c4d4daa1" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d" is_pre_election: true
23:48:34.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.027711  9004 ts_tablet_manager.cc:1434] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.003s
23:48:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:34.028120  7888 leader_election.cc:343] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629): Illegal state: must be running to vote when last-logged opid is not known
23:48:34.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.031574  8999 ts_tablet_manager.cc:1434] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.004s
23:48:34.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.031999  8999 tablet_bootstrap.cc:492] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28: Bootstrap starting.
23:48:34.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.035430  9004 tablet_bootstrap.cc:492] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d: Bootstrap starting.
23:48:34.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:34.039096  8276 tablet.cc:2406] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:34.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.040766  8999 tablet_bootstrap.cc:654] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28: Neither blocks nor log segments found. Creating new log.
23:48:34.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.045078  9004 tablet_bootstrap.cc:654] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d: Neither blocks nor log segments found. Creating new log.
23:48:34.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.048169  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6ef6227b04bf7b893c2f8c4d4daa1" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" is_pre_election: true
23:48:34.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:34.049489  7887 leader_election.cc:343] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321): Illegal state: must be running to vote when last-logged opid is not known
23:48:34.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.049664  7887 leader_election.cc:304] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28; no voters: aae27c6376c146569c5c33fdbdaee87d, e8d81a70facc47cfb042ee26f0f7dd02
23:48:34.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.050120  9003 raft_consensus.cc:2749] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:48:34.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.050653  9004 tablet_bootstrap.cc:492] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d: No bootstrap required, opened a new log
23:48:34.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.050906  9004 ts_tablet_manager.cc:1403] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.001s
23:48:34.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.051503  8999 tablet_bootstrap.cc:492] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28: No bootstrap required, opened a new log
23:48:34.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.051695  8999 ts_tablet_manager.cc:1403] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.001s
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052013  9000 tablet_bootstrap.cc:492] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02: No bootstrap required, opened a new log
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052122  9004 raft_consensus.cc:359] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052343  9004 raft_consensus.cc:385] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052296  9000 ts_tablet_manager.cc:1403] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.031s
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052464  9004 raft_consensus.cc:740] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Initialized, Role: FOLLOWER
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052446  8999 raft_consensus.cc:359] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052659  8999 raft_consensus.cc:385] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052719  8999 raft_consensus.cc:740] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Initialized, Role: FOLLOWER
23:48:34.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.052733  9004 consensus_queue.cc:260] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.053005  8999 consensus_queue.cc:260] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.053596  8999 ts_tablet_manager.cc:1434] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.001s
23:48:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.053905  8999 tablet_bootstrap.cc:492] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28: Bootstrap starting.
23:48:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.055711  8999 tablet_bootstrap.cc:654] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28: Neither blocks nor log segments found. Creating new log.
23:48:34.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.057231  9004 ts_tablet_manager.cc:1434] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
23:48:34.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.059568  9004 tablet_bootstrap.cc:492] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d: Bootstrap starting.
23:48:34.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.062593  9000 raft_consensus.cc:359] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.063053  9000 raft_consensus.cc:385] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.063822  9000 raft_consensus.cc:740] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Initialized, Role: FOLLOWER
23:48:34.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.064221  8999 tablet_bootstrap.cc:492] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28: No bootstrap required, opened a new log
23:48:34.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.064420  8999 ts_tablet_manager.cc:1403] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
23:48:34.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.065174  9004 tablet_bootstrap.cc:654] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d: Neither blocks nor log segments found. Creating new log.
23:48:34.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.065332  8999 raft_consensus.cc:359] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.064261  9000 consensus_queue.cc:260] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.066375  9000 ts_tablet_manager.cc:1434] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.001s
23:48:34.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.065555  8999 raft_consensus.cc:385] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.066663  8999 raft_consensus.cc:740] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Initialized, Role: FOLLOWER
23:48:34.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.066946  8999 consensus_queue.cc:260] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.067546  9000 tablet_bootstrap.cc:492] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02: Bootstrap starting.
23:48:34.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.067574  8999 ts_tablet_manager.cc:1434] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:48:34.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.067901  8999 tablet_bootstrap.cc:492] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28: Bootstrap starting.
23:48:34.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.069643  8999 tablet_bootstrap.cc:654] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28: Neither blocks nor log segments found. Creating new log.
23:48:34.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.070823  9000 tablet_bootstrap.cc:654] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02: Neither blocks nor log segments found. Creating new log.
23:48:34.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.077860  9000 tablet_bootstrap.cc:492] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02: No bootstrap required, opened a new log
23:48:34.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.077934  9004 tablet_bootstrap.cc:492] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d: No bootstrap required, opened a new log
23:48:34.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.078168  9004 ts_tablet_manager.cc:1403] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d: Time spent bootstrapping tablet: real 0.019s	user 0.001s	sys 0.004s
23:48:34.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.078439  9000 ts_tablet_manager.cc:1403] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.001s
23:48:34.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.079348  9004 raft_consensus.cc:359] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.079658  9004 raft_consensus.cc:385] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.079763  9004 raft_consensus.cc:740] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Initialized, Role: FOLLOWER
23:48:34.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.079522  9000 raft_consensus.cc:359] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.080070  9000 raft_consensus.cc:385] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.080240  9000 raft_consensus.cc:740] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Initialized, Role: FOLLOWER
23:48:34.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.080170  9004 consensus_queue.cc:260] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.080904  9004 ts_tablet_manager.cc:1434] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.003s
23:48:34.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.080860  9000 consensus_queue.cc:260] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.081590  9000 ts_tablet_manager.cc:1434] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.002s
23:48:34.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.081866  9004 tablet_bootstrap.cc:492] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d: Bootstrap starting.
23:48:34.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.082160  9000 tablet_bootstrap.cc:492] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02: Bootstrap starting.
23:48:34.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.084633  9000 tablet_bootstrap.cc:654] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02: Neither blocks nor log segments found. Creating new log.
23:48:34.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.084746  9004 tablet_bootstrap.cc:654] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d: Neither blocks nor log segments found. Creating new log.
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.087325  8999 tablet_bootstrap.cc:492] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28: No bootstrap required, opened a new log
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.087383  9004 tablet_bootstrap.cc:492] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d: No bootstrap required, opened a new log
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.087527  9004 ts_tablet_manager.cc:1403] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.087545  8999 ts_tablet_manager.cc:1403] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088382  9004 raft_consensus.cc:359] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088367  8999 raft_consensus.cc:359] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088585  9004 raft_consensus.cc:385] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088620  8999 raft_consensus.cc:385] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088681  9004 raft_consensus.cc:740] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Initialized, Role: FOLLOWER
23:48:34.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088696  8999 raft_consensus.cc:740] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Initialized, Role: FOLLOWER
23:48:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088939  9004 consensus_queue.cc:260] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.088996  8999 consensus_queue.cc:260] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.089488  9004 ts_tablet_manager.cc:1434] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:48:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.089628  8999 ts_tablet_manager.cc:1434] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
23:48:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.089797  9004 tablet_bootstrap.cc:492] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d: Bootstrap starting.
23:48:34.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.089946  8999 tablet_bootstrap.cc:492] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28: Bootstrap starting.
23:48:34.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468114091 for job 6446e0085b210020482ce7a622d23630.
23:48:34.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.091881  8999 tablet_bootstrap.cc:654] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28: Neither blocks nor log segments found. Creating new log.
23:48:34.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.091939  9004 tablet_bootstrap.cc:654] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d: Neither blocks nor log segments found. Creating new log.
23:48:34.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:34.092818  8002 tablet.cc:2406] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:34.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.100128  9003 raft_consensus.cc:493] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.100342  9003 raft_consensus.cc:515] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.101176  9003 leader_election.cc:290] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.101824  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50339fc54f264099966359f5cbc63947" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" is_pre_election: true
23:48:34.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.102237  8228 raft_consensus.cc:2468] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 0.
23:48:34.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.102932  7887 leader_election.cc:304] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.103245  9003 raft_consensus.cc:2804] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:34.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.103364  9003 raft_consensus.cc:493] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:34.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.103454  9003 raft_consensus.cc:3060] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.112 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
23:48:34.114 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
23:48:34.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.119136  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50339fc54f264099966359f5cbc63947" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d" is_pre_election: true
23:48:34.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.119660  8091 raft_consensus.cc:2468] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 0.
23:48:34.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.117997  8999 tablet_bootstrap.cc:492] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28: No bootstrap required, opened a new log
23:48:34.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.127199  8999 ts_tablet_manager.cc:1403] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28: Time spent bootstrapping tablet: real 0.037s	user 0.003s	sys 0.024s
23:48:34.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.127835  9004 tablet_bootstrap.cc:492] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d: No bootstrap required, opened a new log
23:48:34.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128043  9004 ts_tablet_manager.cc:1403] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.018s
23:48:34.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128031  8830 heartbeater.cc:499] Master 127.8.22.252:44235 was elected leader, sending a full tablet report...
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128127  8999 raft_consensus.cc:359] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128352  8999 raft_consensus.cc:385] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128451  8999 raft_consensus.cc:740] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Initialized, Role: FOLLOWER
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128695  8999 consensus_queue.cc:260] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.128916  9004 raft_consensus.cc:359] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.106779  9003 raft_consensus.cc:515] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.129144  9004 raft_consensus.cc:385] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.129215  9004 raft_consensus.cc:740] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Initialized, Role: FOLLOWER
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.129501  9004 consensus_queue.cc:260] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.129814  9003 leader_election.cc:290] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 election: Requested vote from peers aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.130452  9004 ts_tablet_manager.cc:1434] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
23:48:34.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.130987  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50339fc54f264099966359f5cbc63947" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:34.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.131213  8091 raft_consensus.cc:3060] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Advancing to term 1
23:48:34.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.130774  9004 tablet_bootstrap.cc:492] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d: Bootstrap starting.
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.136022  9004 tablet_bootstrap.cc:654] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d: Neither blocks nor log segments found. Creating new log.
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.136308  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50339fc54f264099966359f5cbc63947" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.136627  8228 raft_consensus.cc:3060] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.139047  9000 tablet_bootstrap.cc:492] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02: No bootstrap required, opened a new log
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.139217  9000 ts_tablet_manager.cc:1403] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.022s
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.140205  9000 raft_consensus.cc:359] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.140398  9000 raft_consensus.cc:385] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.140512  9000 raft_consensus.cc:740] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Initialized, Role: FOLLOWER
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.140758  9000 consensus_queue.cc:260] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.141551  9000 ts_tablet_manager.cc:1434] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.141952  9000 tablet_bootstrap.cc:492] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02: Bootstrap starting.
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.142124  8228 raft_consensus.cc:2468] T 50339fc54f264099966359f5cbc63947 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 1.
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.142642  7887 leader_election.cc:304] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.143021  9003 raft_consensus.cc:2804] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Leader election won for term 1
23:48:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.143206  9003 raft_consensus.cc:697] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 LEADER]: Becoming Leader. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Running, Role: LEADER
23:48:34.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.143857  9003 consensus_queue.cc:237] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.149562  9000 tablet_bootstrap.cc:654] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02: Neither blocks nor log segments found. Creating new log.
23:48:34.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.160010  8091 raft_consensus.cc:2468] T 50339fc54f264099966359f5cbc63947 P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 1.
23:48:34.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:34.163507  8139 tablet.cc:2406] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:34.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.173271  7631 catalog_manager.cc:5696] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65). New cstate: current_term: 1 leader_uuid: "1eabd1efdff940dbb721beb9e6190b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } health_report { overall_health: UNKNOWN } } }
23:48:34.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.177119  8999 ts_tablet_manager.cc:1434] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28: Time spent starting tablet: real 0.050s	user 0.000s	sys 0.029s
23:48:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.185328  9007 raft_consensus.cc:493] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.185585  9007 raft_consensus.cc:515] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.186863  9004 tablet_bootstrap.cc:492] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d: No bootstrap required, opened a new log
23:48:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.187099  9004 ts_tablet_manager.cc:1403] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.021s
23:48:34.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.188431  9007 leader_election.cc:290] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:34.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.189656  9004 raft_consensus.cc:359] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.189991  9004 raft_consensus.cc:385] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.190114  9004 raft_consensus.cc:740] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Initialized, Role: FOLLOWER
23:48:34.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.190433  9004 consensus_queue.cc:260] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.193 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:34.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:34.194 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:34.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.198 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.198 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.198 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.191736  9004 ts_tablet_manager.cc:1434] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.002s
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.191902  9011 raft_consensus.cc:493] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.192101  9000 tablet_bootstrap.cc:492] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02: No bootstrap required, opened a new log
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.192283  9000 ts_tablet_manager.cc:1403] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.016s
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.192091  9011 raft_consensus.cc:515] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.193158  9000 raft_consensus.cc:359] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.193365  9000 raft_consensus.cc:385] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.193430  9000 raft_consensus.cc:740] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Initialized, Role: FOLLOWER
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.193671  9000 consensus_queue.cc:260] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.194345  9000 ts_tablet_manager.cc:1434] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
23:48:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.194350  9011 leader_election.cc:290] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.204545  9000 tablet_bootstrap.cc:492] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02: Bootstrap starting.
23:48:34.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.207005  9000 tablet_bootstrap.cc:654] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02: Neither blocks nor log segments found. Creating new log.
23:48:34.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.215068  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7473c87ce1473fab3709d68c863dcd" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" is_pre_election: true
23:48:34.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.215346  8228 raft_consensus.cc:2468] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 0.
23:48:34.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.215865  9000 tablet_bootstrap.cc:492] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02: No bootstrap required, opened a new log
23:48:34.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.216033  9000 ts_tablet_manager.cc:1403] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.216869  9000 raft_consensus.cc:359] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.217092  9000 raft_consensus.cc:385] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.217183  9000 raft_consensus.cc:740] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Initialized, Role: FOLLOWER
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.217350  8024 leader_election.cc:304] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae27c6376c146569c5c33fdbdaee87d, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.217455  9000 consensus_queue.cc:260] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.217939  9011 raft_consensus.cc:2804] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.218067  9011 raft_consensus.cc:493] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.218151  9011 raft_consensus.cc:3060] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Advancing to term 1
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.218698  9000 ts_tablet_manager.cc:1434] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
23:48:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.221163  9011 raft_consensus.cc:515] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.223023  7954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7473c87ce1473fab3709d68c863dcd" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28" is_pre_election: true
23:48:34.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.223552  7954 raft_consensus.cc:2468] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 0.
23:48:34.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.223798  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7473c87ce1473fab3709d68c863dcd" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:34.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.224141  7953 raft_consensus.cc:3060] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.224565  9011 leader_election.cc:290] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 election: Requested vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.225517  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7473c87ce1473fab3709d68c863dcd" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.225759  8228 raft_consensus.cc:3060] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.226917  7953 raft_consensus.cc:2468] T 0a7473c87ce1473fab3709d68c863dcd P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 1.
23:48:34.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.227459  8025 leader_election.cc:304] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, aae27c6376c146569c5c33fdbdaee87d; no voters: 
23:48:34.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.228955  8228 raft_consensus.cc:2468] T 0a7473c87ce1473fab3709d68c863dcd P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 1.
23:48:34.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.229329  9011 raft_consensus.cc:2804] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Leader election won for term 1
23:48:34.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.232625  9011 raft_consensus.cc:697] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [term 1 LEADER]: Becoming Leader. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Running, Role: LEADER
23:48:34.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.233516  9011 consensus_queue.cc:237] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.234001  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6ef6227b04bf7b893c2f8c4d4daa1" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28" is_pre_election: true
23:48:34.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.234268  7953 raft_consensus.cc:2468] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 0.
23:48:34.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.235123  8162 leader_election.cc:304] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.235786  9007 raft_consensus.cc:2804] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:34.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.235930  9007 raft_consensus.cc:493] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:34.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.236038  9007 raft_consensus.cc:3060] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.236322  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6ef6227b04bf7b893c2f8c4d4daa1" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d" is_pre_election: true
23:48:34.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.236536  8091 raft_consensus.cc:2468] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 0.
23:48:34.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.239305  9007 raft_consensus.cc:515] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.240751  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6ef6227b04bf7b893c2f8c4d4daa1" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:34.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.241003  7953 raft_consensus.cc:3060] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.242652  9022 raft_consensus.cc:493] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.242861  9022 raft_consensus.cc:515] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.243300  7631 catalog_manager.cc:5696] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d reported cstate change: term changed from 0 to 1, leader changed from <none> to aae27c6376c146569c5c33fdbdaee87d (127.7.104.66). New cstate: current_term: 1 leader_uuid: "aae27c6376c146569c5c33fdbdaee87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } health_report { overall_health: UNKNOWN } } }
23:48:34.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.243778  9022 leader_election.cc:290] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.244381  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f3a8a917ec4959bafa5da9932eb932" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" is_pre_election: true
23:48:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.244511  7953 raft_consensus.cc:2468] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 1.
23:48:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.244794  8228 raft_consensus.cc:2468] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 0.
23:48:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.244885  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f3a8a917ec4959bafa5da9932eb932" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d" is_pre_election: true
23:48:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.245072  9007 leader_election.cc:290] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 election: Requested vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.245172  8091 raft_consensus.cc:2468] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 0.
23:48:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.245400  9007 raft_consensus.cc:493] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.245471  7887 leader_election.cc:304] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.245546  9007 raft_consensus.cc:515] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.246117  9022 raft_consensus.cc:2804] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:34.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.246145  9007 leader_election.cc:290] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:34.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.246232  9022 raft_consensus.cc:493] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:34.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.246316  9022 raft_consensus.cc:3060] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.251 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:34.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.252974  8090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd39db2759a4265b52a1bcd82c9b355" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d" is_pre_election: true
23:48:34.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.253328  8090 raft_consensus.cc:2468] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 0.
23:48:34.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.253667  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce6ef6227b04bf7b893c2f8c4d4daa1" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:34.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.253880  8091 raft_consensus.cc:3060] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Advancing to term 1
23:48:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.256295  8091 raft_consensus.cc:2468] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 1.
23:48:34.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.257412  8162 leader_election.cc:304] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.257817  9007 raft_consensus.cc:2804] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Leader election won for term 1
23:48:34.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.258070  9007 raft_consensus.cc:697] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 LEADER]: Becoming Leader. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Running, Role: LEADER
23:48:34.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.258458  8162 leader_election.cc:304] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae27c6376c146569c5c33fdbdaee87d, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.260013  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd39db2759a4265b52a1bcd82c9b355" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28" is_pre_election: true
23:48:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.260144  9022 raft_consensus.cc:515] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.260269  7953 raft_consensus.cc:2468] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 0.
23:48:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.260855  9022 leader_election.cc:290] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 election: Requested vote from peers aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.261593  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f3a8a917ec4959bafa5da9932eb932" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:34.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.261873  8091 raft_consensus.cc:3060] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Advancing to term 1
23:48:34.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.258919  9007 consensus_queue.cc:237] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.266880  8091 raft_consensus.cc:2468] T f4f3a8a917ec4959bafa5da9932eb932 P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 1.
23:48:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.267392  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f3a8a917ec4959bafa5da9932eb932" candidate_uuid: "1eabd1efdff940dbb721beb9e6190b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.267647  7888 leader_election.cc:304] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, aae27c6376c146569c5c33fdbdaee87d; no voters: 
23:48:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.268054  9022 raft_consensus.cc:2804] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Leader election won for term 1
23:48:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.268713  9022 raft_consensus.cc:697] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 LEADER]: Becoming Leader. State: Replica: 1eabd1efdff940dbb721beb9e6190b28, State: Running, Role: LEADER
23:48:34.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.269151  9022 consensus_queue.cc:237] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.271898  8228 raft_consensus.cc:3060] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.275871  8228 raft_consensus.cc:2468] T f4f3a8a917ec4959bafa5da9932eb932 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eabd1efdff940dbb721beb9e6190b28 in term 1.
23:48:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.275708  7631 catalog_manager.cc:5696] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65). New cstate: current_term: 1 leader_uuid: "1eabd1efdff940dbb721beb9e6190b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } health_report { overall_health: UNKNOWN } } }
23:48:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.276556  9007 raft_consensus.cc:2804] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.276695  9007 raft_consensus.cc:493] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:34.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.276950  9007 raft_consensus.cc:3060] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.280550  7632 catalog_manager.cc:5696] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67). New cstate: current_term: 1 leader_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } health_report { overall_health: HEALTHY } } }
23:48:34.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.282688  9007 raft_consensus.cc:515] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.283649  9007 leader_election.cc:290] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 election: Requested vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629)
23:48:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.285102  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd39db2759a4265b52a1bcd82c9b355" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.285336  7953 raft_consensus.cc:3060] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.285581  8091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd39db2759a4265b52a1bcd82c9b355" candidate_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae27c6376c146569c5c33fdbdaee87d"
23:48:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.285809  8091 raft_consensus.cc:3060] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Advancing to term 1
23:48:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.288157  7953 raft_consensus.cc:2468] T 0dd39db2759a4265b52a1bcd82c9b355 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 1.
23:48:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.288328  8091 raft_consensus.cc:2468] T 0dd39db2759a4265b52a1bcd82c9b355 P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8d81a70facc47cfb042ee26f0f7dd02 in term 1.
23:48:34.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.289474  8162 leader_election.cc:304] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae27c6376c146569c5c33fdbdaee87d, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.289983  9007 raft_consensus.cc:2804] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Leader election won for term 1
23:48:34.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.290318  9007 raft_consensus.cc:697] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 LEADER]: Becoming Leader. State: Replica: e8d81a70facc47cfb042ee26f0f7dd02, State: Running, Role: LEADER
23:48:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.290743  9007 consensus_queue.cc:237] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.291061  9011 raft_consensus.cc:493] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.291239  9011 raft_consensus.cc:515] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.292711  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4238b4248ecd495d9d7fe29bf37abc0b" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28" is_pre_election: true
23:48:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.292874  9011 leader_election.cc:290] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.293033  7953 raft_consensus.cc:2468] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 0.
23:48:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.293445  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4238b4248ecd495d9d7fe29bf37abc0b" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" is_pre_election: true
23:48:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.293557  8025 leader_election.cc:304] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eabd1efdff940dbb721beb9e6190b28, aae27c6376c146569c5c33fdbdaee87d; no voters: 
23:48:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.293675  8228 raft_consensus.cc:2468] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 0.
23:48:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.293875  9011 raft_consensus.cc:2804] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.293977  9011 raft_consensus.cc:493] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.294085  9011 raft_consensus.cc:3060] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 0 FOLLOWER]: Advancing to term 1
23:48:34.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.296880  7632 catalog_manager.cc:5696] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67). New cstate: current_term: 1 leader_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } health_report { overall_health: HEALTHY } } }
23:48:34.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.298622  9011 raft_consensus.cc:515] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.300551  7953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4238b4248ecd495d9d7fe29bf37abc0b" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1eabd1efdff940dbb721beb9e6190b28"
23:48:34.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.300884  7953 raft_consensus.cc:3060] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.301119  8228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4238b4248ecd495d9d7fe29bf37abc0b" candidate_uuid: "aae27c6376c146569c5c33fdbdaee87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8d81a70facc47cfb042ee26f0f7dd02"
23:48:34.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.301331  8228 raft_consensus.cc:3060] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 0 FOLLOWER]: Advancing to term 1
23:48:34.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.302932  9011 leader_election.cc:290] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 election: Requested vote from peers 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995), e8d81a70facc47cfb042ee26f0f7dd02 (127.7.104.67:35321)
23:48:34.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.304507  8228 raft_consensus.cc:2468] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 1.
23:48:34.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.305063  7953 raft_consensus.cc:2468] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae27c6376c146569c5c33fdbdaee87d in term 1.
23:48:34.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.305127  8024 leader_election.cc:304] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae27c6376c146569c5c33fdbdaee87d, e8d81a70facc47cfb042ee26f0f7dd02; no voters: 
23:48:34.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.306239  9011 raft_consensus.cc:2804] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Leader election won for term 1
23:48:34.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.307056  9011 raft_consensus.cc:697] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [term 1 LEADER]: Becoming Leader. State: Replica: aae27c6376c146569c5c33fdbdaee87d, State: Running, Role: LEADER
23:48:34.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.307377  9011 consensus_queue.cc:237] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } }
23:48:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.310717  7632 catalog_manager.cc:5696] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d reported cstate change: term changed from 0 to 1, leader changed from <none> to aae27c6376c146569c5c33fdbdaee87d (127.7.104.66). New cstate: current_term: 1 leader_uuid: "aae27c6376c146569c5c33fdbdaee87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 } health_report { overall_health: UNKNOWN } } }
23:48:34.368 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:34.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:34.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:34.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:34.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:34.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:34.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:34.373 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:34.373 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.7.104.126:33577, [4ms] Sub RPC GetTableLocations: received response from server master-127.7.104.126:33577: OK, deferred=null) after lookup
23:48:34.374 [DEBUG - kudu-nio-1] (Connection.java:748) [peer e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)] connecting to peer
23:48:34.375 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)] Successfully connected to peer
23:48:34.386 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.389 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xba7a6d00, L:/127.0.0.1:42546 - R:/127.7.104.67:35321] using TOKEN/null
23:48:34.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.400588  8091 raft_consensus.cc:1275] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P aae27c6376c146569c5c33fdbdaee87d [term 1 FOLLOWER]: Refusing update from remote peer e8d81a70facc47cfb042ee26f0f7dd02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:34.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.400733  7953 raft_consensus.cc:1275] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Refusing update from remote peer e8d81a70facc47cfb042ee26f0f7dd02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:34.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.401849  9007 consensus_queue.cc:1048] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.402256  9035 consensus_queue.cc:1048] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.404 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468114402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:34.422 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
23:48:34.425 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
23:48:34.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.436177  9042 mvcc.cc:204] Tried to move back new op lower bound from 7305085396572041216 to 7305085396046684160. Current Snapshot: MvccSnapshot[applied={T|T < 7305085396572041216}]
23:48:34.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.440732  9043 mvcc.cc:204] Tried to move back new op lower bound from 7305085396572041216 to 7305085396046684160. Current Snapshot: MvccSnapshot[applied={T|T < 7305085396572041216}]
23:48:34.455 [DEBUG - main] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:34.457 [DEBUG - kudu-nio-4] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:34.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.470753  9044 mvcc.cc:204] Tried to move back new op lower bound from 7305085396572041216 to 7305085396046684160. Current Snapshot: MvccSnapshot[applied={T|T < 7305085396572041216}]
23:48:34.472 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.477 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x8308ca89, L:/127.0.0.1:57572 - R:/127.7.104.66:35629] using TOKEN/null
23:48:34.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.482733  7953 raft_consensus.cc:1275] T 4238b4248ecd495d9d7fe29bf37abc0b P 1eabd1efdff940dbb721beb9e6190b28 [term 1 FOLLOWER]: Refusing update from remote peer aae27c6376c146569c5c33fdbdaee87d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:34.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.483175  8228 raft_consensus.cc:1275] T 4238b4248ecd495d9d7fe29bf37abc0b P e8d81a70facc47cfb042ee26f0f7dd02 [term 1 FOLLOWER]: Refusing update from remote peer aae27c6376c146569c5c33fdbdaee87d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:34.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.483911  9033 consensus_queue.cc:1048] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.484995  9033 consensus_queue.cc:1048] T 4238b4248ecd495d9d7fe29bf37abc0b P aae27c6376c146569c5c33fdbdaee87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.591 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468114591 for job 6446e0085b210020482ce7a622d23630.
23:48:34.597 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:34.598 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:34.598 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:34.598 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:34.598 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:34.598 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:34.599 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:34.599 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:34.599 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:34.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:34.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:34.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:34.599 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:34.602 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:34.605 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:48:34.605 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:34.606 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
23:48:34.607 [DEBUG - main] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:48:34.607 [DEBUG - main] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:48:34.614 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.8.22.252:44235(127.8.22.252:44235)] Successfully connected to peer
23:48:34.615 [DEBUG - main] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:48:34.616 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.8.22.253:33181(127.8.22.253:33181)] Successfully connected to peer
23:48:34.618 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.253
23:48:34.619 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.8.22.254:45201(127.8.22.254:45201)] Successfully connected to peer
23:48:34.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.625311  9033 consensus_queue.cc:1048] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.626 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.629 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x76a61619, L:/127.0.0.1:37546 - R:/127.8.22.253:33181] using SASL/PLAIN
23:48:34.639 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:34.639 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:34.640 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:34.641 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.641 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.641 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.642 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.642 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.642 [DEBUG - pool-44-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [9ms] received response from server master-127.3.230.252:37691: OK, deferred=null) with no deferred attached!
23:48:34.642 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.643 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.643 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.643 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.643 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:34.645 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.252
23:48:34.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.646787  9033 consensus_queue.cc:1048] T 0a7473c87ce1473fab3709d68c863dcd P aae27c6376c146569c5c33fdbdaee87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.647719  9022 consensus_queue.cc:1048] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.655 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.659 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd473f3e0, L:/127.0.0.1:57324 - R:/127.8.22.252:44235] using SASL/PLAIN
23:48:34.660 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.254
23:48:34.663 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:34.663 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=57), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.252:44235, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.253:33181, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.254:45201, [24ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.253:33181: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.252:44235: OK, deferred=null) after lookup
23:48:34.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.668023  9003 consensus_queue.cc:1048] T 50339fc54f264099966359f5cbc63947 P 1eabd1efdff940dbb721beb9e6190b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.675 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:34.676 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:34.676 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:34.677 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:34.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:34.677 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:34.677 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:34.677 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:34.677 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:34.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:34.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:34.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:34.677 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:34.680 [DEBUG - main] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:34.690 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.693883  8968 heartbeater.cc:499] Master 127.8.22.252:44235 was elected leader, sending a full tablet report...
23:48:34.698 [DEBUG - main] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:34.700 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.104.125:36473(127.7.104.125:36473)] Successfully connected to peer
23:48:34.702 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.125
23:48:34.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.709805  9003 consensus_queue.cc:1048] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8d81a70facc47cfb042ee26f0f7dd02" member_type: VOTER last_known_addr { host: "127.7.104.67" port: 35321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.713 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.713 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1dbb1e43, L:/127.0.0.1:36382 - R:/127.8.22.254:45201] using SASL/PLAIN
23:48:34.717 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaeab5a7e, L:/127.0.0.1:60974 - R:/127.7.104.125:36473] using SASL/PLAIN
23:48:34.717 [DEBUG - main] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:34.719 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.104.126:33577(127.7.104.126:33577)] Successfully connected to peer
23:48:34.722 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.104.124:39307(127.7.104.124:39307)] Successfully connected to peer
23:48:34.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.725291  9003 consensus_queue.cc:1048] T f4f3a8a917ec4959bafa5da9932eb932 P 1eabd1efdff940dbb721beb9e6190b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.727 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.126
23:48:34.742 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.743 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.124
23:48:34.746 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbfec0b33, L:/127.0.0.1:45988 - R:/127.7.104.126:33577] using SASL/PLAIN
23:48:34.750 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:34.752 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:34.752 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=72), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [38ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: OK, deferred=null) after lookup
23:48:34.755 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:34.760 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:34.761 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:34.762 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:34.763 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:34.763 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:34.763 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:34.763 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:34.763 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc58a6319, L:/127.0.0.1:34552 - R:/127.7.104.124:39307] using SASL/PLAIN
23:48:34.763 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.766088  8469 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57324:
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:34.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\0012\000\000\000"
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:34.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:48:34.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:34.768466  8469 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:34.787 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:34.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.794252  9036 consensus_queue.cc:1048] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1eabd1efdff940dbb721beb9e6190b28" member_type: VOTER last_known_addr { host: "127.7.104.65" port: 45995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.832762  9035 consensus_queue.cc:1048] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae27c6376c146569c5c33fdbdaee87d" member_type: VOTER last_known_addr { host: "127.7.104.66" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:34.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.844698  8764 tablet_service.cc:1511] Processing CreateTablet for tablet b4d3a334030d4353921fc9bde4b759f4 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
23:48:34.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.846236  8765 tablet_service.cc:1511] Processing CreateTablet for tablet 661b3ac37579429493abf420457e9e8a (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
23:48:34.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.847276  8764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d3a334030d4353921fc9bde4b759f4. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:34.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.848109  8765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661b3ac37579429493abf420457e9e8a. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:34.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.865767  9092 tablet_bootstrap.cc:492] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: Bootstrap starting.
23:48:34.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.877133  9092 tablet_bootstrap.cc:654] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: Neither blocks nor log segments found. Creating new log.
23:48:34.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.878971  9092 log.cc:826] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: Log is configured to *not* fsync() on all Append() calls
23:48:34.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.885748  8628 tablet_service.cc:1511] Processing CreateTablet for tablet 661b3ac37579429493abf420457e9e8a (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
23:48:34.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.887362  8627 tablet_service.cc:1511] Processing CreateTablet for tablet b4d3a334030d4353921fc9bde4b759f4 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
23:48:34.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.888434  8628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661b3ac37579429493abf420457e9e8a. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:34.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.890986  8627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d3a334030d4353921fc9bde4b759f4. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:34.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.891013  9092 tablet_bootstrap.cc:492] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: No bootstrap required, opened a new log
23:48:34.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.891394  9092 ts_tablet_manager.cc:1403] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.009s
23:48:34.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.892675  8902 tablet_service.cc:1511] Processing CreateTablet for tablet b4d3a334030d4353921fc9bde4b759f4 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
23:48:34.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.894556  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d3a334030d4353921fc9bde4b759f4. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:34.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.895087  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 661b3ac37579429493abf420457e9e8a (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
23:48:34.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.895812  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661b3ac37579429493abf420457e9e8a. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:34.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.899595  9092 raft_consensus.cc:359] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:34.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.900031  9092 raft_consensus.cc:385] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.900141  9092 raft_consensus.cc:740] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183b79dc80df4a9583cef13752304681, State: Initialized, Role: FOLLOWER
23:48:34.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.901028  9092 consensus_queue.cc:260] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:34.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468114902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:34.913 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:34.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
23:48:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.921821  9096 tablet_bootstrap.cc:492] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: Bootstrap starting.
23:48:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.922968  9095 tablet_bootstrap.cc:492] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: Bootstrap starting.
23:48:34.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.923506  9092 ts_tablet_manager.cc:1434] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.002s
23:48:34.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.924008  9092 tablet_bootstrap.cc:492] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681: Bootstrap starting.
23:48:34.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.925976  9092 tablet_bootstrap.cc:654] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681: Neither blocks nor log segments found. Creating new log.
23:48:34.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.934131  9095 tablet_bootstrap.cc:654] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: Neither blocks nor log segments found. Creating new log.
23:48:34.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.935860  9095 log.cc:826] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: Log is configured to *not* fsync() on all Append() calls
23:48:34.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.938701  9095 tablet_bootstrap.cc:492] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: No bootstrap required, opened a new log
23:48:34.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.939047  9095 ts_tablet_manager.cc:1403] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.003s
23:48:34.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.940071  9096 tablet_bootstrap.cc:654] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: Neither blocks nor log segments found. Creating new log.
23:48:34.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.941713  9096 log.cc:826] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: Log is configured to *not* fsync() on all Append() calls
23:48:34.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.944046  9092 tablet_bootstrap.cc:492] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681: No bootstrap required, opened a new log
23:48:34.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.944208  9092 ts_tablet_manager.cc:1403] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
23:48:34.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.945104  9096 tablet_bootstrap.cc:492] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: No bootstrap required, opened a new log
23:48:34.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.945243  9092 raft_consensus.cc:359] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:34.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.945457  9092 raft_consensus.cc:385] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.945457  9096 ts_tablet_manager.cc:1403] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: Time spent bootstrapping tablet: real 0.024s	user 0.000s	sys 0.008s
23:48:34.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.945541  9092 raft_consensus.cc:740] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183b79dc80df4a9583cef13752304681, State: Initialized, Role: FOLLOWER
23:48:34.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.945789  9092 consensus_queue.cc:260] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:34.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.946367  9092 ts_tablet_manager.cc:1434] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:48:34.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.951241  9095 raft_consensus.cc:359] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:34.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.952073  9095 raft_consensus.cc:385] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.952184  9095 raft_consensus.cc:740] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fff25c44dbc403aa121b78bede605f8, State: Initialized, Role: FOLLOWER
23:48:34.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.952967  9095 consensus_queue.cc:260] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.955108  9095 ts_tablet_manager.cc:1434] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.003s
23:48:34.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.955981  9095 tablet_bootstrap.cc:492] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8: Bootstrap starting.
23:48:34.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.958012  9095 tablet_bootstrap.cc:654] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8: Neither blocks nor log segments found. Creating new log.
23:48:34.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.955390  9096 raft_consensus.cc:359] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:34.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.959846  9096 raft_consensus.cc:385] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.959992  9096 raft_consensus.cc:740] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Initialized, Role: FOLLOWER
23:48:34.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.961396  9096 consensus_queue.cc:260] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:34.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.963866  9096 ts_tablet_manager.cc:1434] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
23:48:34.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.966990  9095 tablet_bootstrap.cc:492] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8: No bootstrap required, opened a new log
23:48:34.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.967173  9095 ts_tablet_manager.cc:1403] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
23:48:34.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.968297  9095 raft_consensus.cc:359] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:34.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.968484  9095 raft_consensus.cc:385] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.968568  9095 raft_consensus.cc:740] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fff25c44dbc403aa121b78bede605f8, State: Initialized, Role: FOLLOWER
23:48:34.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.968802  9095 consensus_queue.cc:260] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:34.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.969310  9095 ts_tablet_manager.cc:1434] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:48:34.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.969360  9096 tablet_bootstrap.cc:492] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4: Bootstrap starting.
23:48:34.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.972079  9096 tablet_bootstrap.cc:654] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4: Neither blocks nor log segments found. Creating new log.
23:48:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.974938  9096 tablet_bootstrap.cc:492] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4: No bootstrap required, opened a new log
23:48:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.975078  9096 ts_tablet_manager.cc:1403] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.001s
23:48:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.975920  9096 raft_consensus.cc:359] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.976066  9096 raft_consensus.cc:385] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.976123  9096 raft_consensus.cc:740] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Initialized, Role: FOLLOWER
23:48:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.976296  9096 consensus_queue.cc:260] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:34.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:34.977156  9096 ts_tablet_manager.cc:1434] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
23:48:34.993 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:34.993 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:34.994 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:34.994 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.994 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.994 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:34.994 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.994 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:34.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:34.994 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.025122  8696 tablet.cc:2406] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:35.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.028472  9102 raft_consensus.cc:493] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:35.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.028811  9102 raft_consensus.cc:515] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:35.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.044263  9102 leader_election.cc:290] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.054118  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661b3ac37579429493abf420457e9e8a" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681" is_pre_election: true
23:48:35.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.054301  9102 raft_consensus.cc:493] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:35.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.054507  9102 raft_consensus.cc:515] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.054693  8785 raft_consensus.cc:2468] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.055 [DEBUG - pool-46-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [5ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.055948  8583 leader_election.cc:304] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.056607  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661b3ac37579429493abf420457e9e8a" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8" is_pre_election: true
23:48:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.056872  9106 raft_consensus.cc:2804] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.057022  9106 raft_consensus.cc:493] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.057155  9106 raft_consensus.cc:3060] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.057179  8923 raft_consensus.cc:2468] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.057538  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4d3a334030d4353921fc9bde4b759f4" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8" is_pre_election: true
23:48:35.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.057821  8922 raft_consensus.cc:2468] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.058184  9102 leader_election.cc:290] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.058344  8584 leader_election.cc:304] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fff25c44dbc403aa121b78bede605f8, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.059599  9102 raft_consensus.cc:2804] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:35.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.059710  9102 raft_consensus.cc:493] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:35.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.059828  9102 raft_consensus.cc:3060] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.060032  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4d3a334030d4353921fc9bde4b759f4" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681" is_pre_election: true
23:48:35.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.060226  8785 raft_consensus.cc:2468] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.060698  9106 raft_consensus.cc:515] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:35.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.062323  9106 leader_election.cc:290] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Requested vote from peers 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.062292  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661b3ac37579429493abf420457e9e8a" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681"
23:48:35.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.062433  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661b3ac37579429493abf420457e9e8a" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.062527  8785 raft_consensus.cc:3060] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.062644  8922 raft_consensus.cc:3060] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.065124  8785 raft_consensus.cc:2468] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.065702  8583 leader_election.cc:304] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.066779  8922 raft_consensus.cc:2468] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.067004  9106 raft_consensus.cc:2804] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Leader election won for term 1
23:48:35.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.069108  9102 raft_consensus.cc:515] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.070643  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4d3a334030d4353921fc9bde4b759f4" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:35.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.070931  8922 raft_consensus.cc:3060] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.071417  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4d3a334030d4353921fc9bde4b759f4" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681"
23:48:35.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.071699  8785 raft_consensus.cc:3060] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.075078  8922 raft_consensus.cc:2468] T b4d3a334030d4353921fc9bde4b759f4 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.075927  8584 leader_election.cc:304] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fff25c44dbc403aa121b78bede605f8, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.079957  8785 raft_consensus.cc:2468] T b4d3a334030d4353921fc9bde4b759f4 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.080 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [7ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.080 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30004), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [5ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.082989  9102 leader_election.cc:290] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Requested vote from peers 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.083706  9102 raft_consensus.cc:2804] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Leader election won for term 1
23:48:35.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.083992  9102 raft_consensus.cc:697] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Running, Role: LEADER
23:48:35.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.084735  9102 consensus_queue.cc:237] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.088291  9106 raft_consensus.cc:697] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Running, Role: LEADER
23:48:35.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.088793  9106 consensus_queue.cc:237] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } }
23:48:35.094 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468115091 for job 6446e0085b210020482ce7a622d23630.
23:48:35.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.101207  8468 catalog_manager.cc:5696] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193). New cstate: current_term: 1 leader_uuid: "2100c738f2f94e4884d53e49614df1c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } health_report { overall_health: HEALTHY } } }
23:48:35.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.114470  8840 tablet.cc:2406] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:35.117 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=26 ms, finalizationTime=0 ms).
23:48:35.118 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
23:48:35.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.119398  8468 catalog_manager.cc:5696] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193). New cstate: current_term: 1 leader_uuid: "2100c738f2f94e4884d53e49614df1c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } health_report { overall_health: UNKNOWN } } }
23:48:35.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.142745  8971 tablet.cc:2406] T 661b3ac37579429493abf420457e9e8a P 1fff25c44dbc403aa121b78bede605f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:35.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.171375  8468 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57324:
23:48:35.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\0012\000\000\000\007\001\226\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
23:48:35.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.180968  8468 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cc02dfd5e5f4f678682f0beeac3a290 has no consensus state
23:48:35.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.181864  8468 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb7c93703cbb4db6be37110dbd6d4d0b has no consensus state
23:48:35.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.190086  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 4cc02dfd5e5f4f678682f0beeac3a290 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:35.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.190526  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cc02dfd5e5f4f678682f0beeac3a290. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.190382  8627 tablet_service.cc:1511] Processing CreateTablet for tablet 4cc02dfd5e5f4f678682f0beeac3a290 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:35.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.190958  8627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cc02dfd5e5f4f678682f0beeac3a290. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.192538  8902 tablet_service.cc:1511] Processing CreateTablet for tablet fb7c93703cbb4db6be37110dbd6d4d0b (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:35.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.193027  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7c93703cbb4db6be37110dbd6d4d0b. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.196678  9095 tablet_bootstrap.cc:492] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8: Bootstrap starting.
23:48:35.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.197687  8765 tablet_service.cc:1511] Processing CreateTablet for tablet 4cc02dfd5e5f4f678682f0beeac3a290 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:35.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.197752  8628 tablet_service.cc:1511] Processing CreateTablet for tablet fb7c93703cbb4db6be37110dbd6d4d0b (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:35.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.198206  8765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cc02dfd5e5f4f678682f0beeac3a290. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.198225  8628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7c93703cbb4db6be37110dbd6d4d0b. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.198640  9095 tablet_bootstrap.cc:654] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8: Neither blocks nor log segments found. Creating new log.
23:48:35.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.203698  8764 tablet_service.cc:1511] Processing CreateTablet for tablet fb7c93703cbb4db6be37110dbd6d4d0b (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
23:48:35.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.203984  9095 tablet_bootstrap.cc:492] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8: No bootstrap required, opened a new log
23:48:35.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.204210  8764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7c93703cbb4db6be37110dbd6d4d0b. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.204236  9095 ts_tablet_manager.cc:1403] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.000s
23:48:35.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.205114  9095 raft_consensus.cc:359] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.205331  9095 raft_consensus.cc:385] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.205397  9095 raft_consensus.cc:740] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fff25c44dbc403aa121b78bede605f8, State: Initialized, Role: FOLLOWER
23:48:35.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.205675  9095 consensus_queue.cc:260] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.206197  9095 ts_tablet_manager.cc:1434] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:48:35.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.207805  9095 tablet_bootstrap.cc:492] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8: Bootstrap starting.
23:48:35.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.209703  9096 tablet_bootstrap.cc:492] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4: Bootstrap starting.
23:48:35.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.210359  9095 tablet_bootstrap.cc:654] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8: Neither blocks nor log segments found. Creating new log.
23:48:35.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.211668  9096 tablet_bootstrap.cc:654] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4: Neither blocks nor log segments found. Creating new log.
23:48:35.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.212904  8454 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 4cc02dfd5e5f4f678682f0beeac3a290 (table replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4cc02dfd5e5f4f678682f0beeac3a290 consensus state has no leader
23:48:35.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.213678  9092 tablet_bootstrap.cc:492] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681: Bootstrap starting.
23:48:35.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.215876  9092 tablet_bootstrap.cc:654] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681: Neither blocks nor log segments found. Creating new log.
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.220643  9096 tablet_bootstrap.cc:492] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4: No bootstrap required, opened a new log
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.220990  9096 ts_tablet_manager.cc:1403] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.221231  9095 tablet_bootstrap.cc:492] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8: No bootstrap required, opened a new log
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.221398  9095 ts_tablet_manager.cc:1403] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.007s
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222133  9096 raft_consensus.cc:359] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222416  9096 raft_consensus.cc:385] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222378  9095 raft_consensus.cc:359] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222535  9095 raft_consensus.cc:385] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222515  9096 raft_consensus.cc:740] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Initialized, Role: FOLLOWER
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222596  9095 raft_consensus.cc:740] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fff25c44dbc403aa121b78bede605f8, State: Initialized, Role: FOLLOWER
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222865  9096 consensus_queue.cc:260] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.222887  9095 consensus_queue.cc:260] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.223523  9095 ts_tablet_manager.cc:1434] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:35.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.225214  9092 tablet_bootstrap.cc:492] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681: No bootstrap required, opened a new log
23:48:35.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.225421  9092 ts_tablet_manager.cc:1403] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.007s
23:48:35.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.226411  9096 ts_tablet_manager.cc:1434] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
23:48:35.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.226961  9096 tablet_bootstrap.cc:492] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4: Bootstrap starting.
23:48:35.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.229876  9092 raft_consensus.cc:359] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.230115  9092 raft_consensus.cc:385] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.230192  9092 raft_consensus.cc:740] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183b79dc80df4a9583cef13752304681, State: Initialized, Role: FOLLOWER
23:48:35.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.230477  9092 consensus_queue.cc:260] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.231093  9092 ts_tablet_manager.cc:1434] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
23:48:35.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.232118  9096 tablet_bootstrap.cc:654] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4: Neither blocks nor log segments found. Creating new log.
23:48:35.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.233687  8468 catalog_manager.cc:6241] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d] alter complete (version 0)
23:48:35.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.235296  9092 tablet_bootstrap.cc:492] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681: Bootstrap starting.
23:48:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.240199  9096 tablet_bootstrap.cc:492] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4: No bootstrap required, opened a new log
23:48:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.240492  9092 tablet_bootstrap.cc:654] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681: Neither blocks nor log segments found. Creating new log.
23:48:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.240723  9096 ts_tablet_manager.cc:1403] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.000s
23:48:35.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.241801  9096 raft_consensus.cc:359] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.242116  9096 raft_consensus.cc:385] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.242395  9096 raft_consensus.cc:740] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Initialized, Role: FOLLOWER
23:48:35.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.242868  9096 consensus_queue.cc:260] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.243677  9096 ts_tablet_manager.cc:1434] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.002s
23:48:35.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:35.248 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30000), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [9ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.250418  9092 tablet_bootstrap.cc:492] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681: No bootstrap required, opened a new log
23:48:35.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.250648  9092 ts_tablet_manager.cc:1403] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.003s
23:48:35.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.251410  8468 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57324:
23:48:35.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\226\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
23:48:35.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.254657  9092 raft_consensus.cc:359] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.254899  9092 raft_consensus.cc:385] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.264099  8468 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cc02dfd5e5f4f678682f0beeac3a290 consensus state has no leader
23:48:35.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.264325  8468 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 055500fad9db4cffb040b3818af066b3 has no consensus state
23:48:35.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.264834  8468 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb7c93703cbb4db6be37110dbd6d4d0b consensus state has no leader
23:48:35.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:35.265195  8468 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff0ff57d18644a9285d2c0bca1167e06 has no consensus state
23:48:35.268 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [11ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.268 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [10ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.268 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [11ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.254992  9092 raft_consensus.cc:740] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183b79dc80df4a9583cef13752304681, State: Initialized, Role: FOLLOWER
23:48:35.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.270026  9092 consensus_queue.cc:260] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.271624  9092 ts_tablet_manager.cc:1434] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.000s
23:48:35.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.276183  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 055500fad9db4cffb040b3818af066b3 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
23:48:35.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.276742  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055500fad9db4cffb040b3818af066b3. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.278327  8627 tablet_service.cc:1511] Processing CreateTablet for tablet 055500fad9db4cffb040b3818af066b3 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
23:48:35.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.278728  8764 tablet_service.cc:1511] Processing CreateTablet for tablet 055500fad9db4cffb040b3818af066b3 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
23:48:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.279223  8764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055500fad9db4cffb040b3818af066b3. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.279172  8628 tablet_service.cc:1511] Processing CreateTablet for tablet ff0ff57d18644a9285d2c0bca1167e06 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
23:48:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.279747  8627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 055500fad9db4cffb040b3818af066b3. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.280045  8903 tablet_service.cc:1511] Processing CreateTablet for tablet ff0ff57d18644a9285d2c0bca1167e06 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
23:48:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.280440  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0ff57d18644a9285d2c0bca1167e06. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.282614  8628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0ff57d18644a9285d2c0bca1167e06. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.283283  8765 tablet_service.cc:1511] Processing CreateTablet for tablet ff0ff57d18644a9285d2c0bca1167e06 (DEFAULT_TABLE table=replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
23:48:35.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.283803  8765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0ff57d18644a9285d2c0bca1167e06. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:35.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.289839  9096 tablet_bootstrap.cc:492] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4: Bootstrap starting.
23:48:35.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.292450  9096 tablet_bootstrap.cc:654] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4: Neither blocks nor log segments found. Creating new log.
23:48:35.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.297562  9092 tablet_bootstrap.cc:492] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681: Bootstrap starting.
23:48:35.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.299823  9095 tablet_bootstrap.cc:492] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8: Bootstrap starting.
23:48:35.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.300109  9092 tablet_bootstrap.cc:654] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681: Neither blocks nor log segments found. Creating new log.
23:48:35.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.301502  9096 tablet_bootstrap.cc:492] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4: No bootstrap required, opened a new log
23:48:35.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.301573  9095 tablet_bootstrap.cc:654] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8: Neither blocks nor log segments found. Creating new log.
23:48:35.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.302012  9096 ts_tablet_manager.cc:1403] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
23:48:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.303228  9096 raft_consensus.cc:359] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.303714  9096 raft_consensus.cc:385] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.303911  9096 raft_consensus.cc:740] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Initialized, Role: FOLLOWER
23:48:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.304428  9096 consensus_queue.cc:260] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.305354  9095 tablet_bootstrap.cc:492] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8: No bootstrap required, opened a new log
23:48:35.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.305598  9095 ts_tablet_manager.cc:1403] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.001s
23:48:35.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.311570  9096 ts_tablet_manager.cc:1434] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
23:48:35.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.306936  9095 raft_consensus.cc:359] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.311925  9095 raft_consensus.cc:385] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.312044  9095 raft_consensus.cc:740] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fff25c44dbc403aa121b78bede605f8, State: Initialized, Role: FOLLOWER
23:48:35.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.312567  9095 consensus_queue.cc:260] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.316852  9096 tablet_bootstrap.cc:492] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4: Bootstrap starting.
23:48:35.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.317566  9092 tablet_bootstrap.cc:492] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681: No bootstrap required, opened a new log
23:48:35.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.317775  9092 ts_tablet_manager.cc:1403] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
23:48:35.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.318671  9092 raft_consensus.cc:359] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.318929  9092 raft_consensus.cc:385] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.319024  9092 raft_consensus.cc:740] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183b79dc80df4a9583cef13752304681, State: Initialized, Role: FOLLOWER
23:48:35.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.319362  9092 consensus_queue.cc:260] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.319902  9092 ts_tablet_manager.cc:1434] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:35.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.320250  9092 tablet_bootstrap.cc:492] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681: Bootstrap starting.
23:48:35.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.321434  9096 tablet_bootstrap.cc:654] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4: Neither blocks nor log segments found. Creating new log.
23:48:35.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.322052  9092 tablet_bootstrap.cc:654] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681: Neither blocks nor log segments found. Creating new log.
23:48:35.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.327077  9092 tablet_bootstrap.cc:492] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681: No bootstrap required, opened a new log
23:48:35.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.327242  9092 ts_tablet_manager.cc:1403] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.001s
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.327840  9095 ts_tablet_manager.cc:1434] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.000s
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328166  9096 tablet_bootstrap.cc:492] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4: No bootstrap required, opened a new log
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328076  9092 raft_consensus.cc:359] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328266  9092 raft_consensus.cc:385] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328361  9092 raft_consensus.cc:740] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183b79dc80df4a9583cef13752304681, State: Initialized, Role: FOLLOWER
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328447  9095 tablet_bootstrap.cc:492] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8: Bootstrap starting.
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328661  9096 ts_tablet_manager.cc:1403] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4: Time spent bootstrapping tablet: real 0.012s	user 0.000s	sys 0.007s
23:48:35.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.328624  9092 consensus_queue.cc:260] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.329161  9092 ts_tablet_manager.cc:1434] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:48:35.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.331391  9096 raft_consensus.cc:359] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.331758  9096 raft_consensus.cc:385] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.331966  9096 raft_consensus.cc:740] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Initialized, Role: FOLLOWER
23:48:35.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.332373  9096 consensus_queue.cc:260] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.338351  9095 tablet_bootstrap.cc:654] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8: Neither blocks nor log segments found. Creating new log.
23:48:35.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.341120  9096 ts_tablet_manager.cc:1434] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.001s
23:48:35.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.341408  9095 tablet_bootstrap.cc:492] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8: No bootstrap required, opened a new log
23:48:35.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.341571  9095 ts_tablet_manager.cc:1403] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.003s
23:48:35.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.342415  9095 raft_consensus.cc:359] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.342597  9095 raft_consensus.cc:385] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:35.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.336989  8468 catalog_manager.cc:6241] T 00000000000000000000000000000000 P b870a640edce46c4aa732d8389b94377: replication_test_table [id=8d6a58dc6d31435d98989ef54369be6d] alter complete (version 0)
23:48:35.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.342742  9095 raft_consensus.cc:740] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fff25c44dbc403aa121b78bede605f8, State: Initialized, Role: FOLLOWER
23:48:35.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.343091  9095 consensus_queue.cc:260] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.343621  9095 ts_tablet_manager.cc:1434] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:35.349 [DEBUG - main] (Connection.java:575) [peer master-127.7.104.126:33577(127.7.104.126:33577)] disconnecting while in state READY
23:48:35.349 [DEBUG - main] (Connection.java:575) [peer master-127.7.104.125:36473(127.7.104.125:36473)] disconnecting while in state READY
23:48:35.349 [DEBUG - main] (Connection.java:575) [peer master-127.7.104.124:39307(127.7.104.124:39307)] disconnecting while in state READY
23:48:35.352 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.104.126:33577(127.7.104.126:33577)] handling channelInactive
23:48:35.352 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state READY due to: connection closed
23:48:35.353 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.104.125:36473(127.7.104.125:36473)] handling channelInactive
23:48:35.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state READY due to: connection closed
23:48:35.353 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:35.354 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:35.355 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:48:35.356 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.104.124:39307(127.7.104.124:39307)] handling channelInactive
23:48:35.356 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state READY due to: connection closed
23:48:35.356 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:48:35.356 [DEBUG - main] (Connection.java:575) [peer master-127.8.22.253:33181(127.8.22.253:33181)] disconnecting while in state READY
23:48:35.356 [DEBUG - main] (Connection.java:575) [peer master-127.8.22.254:45201(127.8.22.254:45201)] disconnecting while in state READY
23:48:35.356 [DEBUG - main] (Connection.java:575) [peer master-127.8.22.252:44235(127.8.22.252:44235)] disconnecting while in state READY
23:48:35.357 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.8.22.254:45201(127.8.22.254:45201)] handling channelInactive
23:48:35.359 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state READY due to: connection closed
23:48:35.357 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.8.22.253:33181(127.8.22.253:33181)] handling channelInactive
23:48:35.361 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state READY due to: connection closed
23:48:35.367 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:35.368 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:48:35.368 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:48:35.369 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.8.22.252:44235(127.8.22.252:44235)] handling channelInactive
23:48:35.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state READY due to: connection closed
23:48:35.369 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
23:48:35.371 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:35.371 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:48:35.371 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:48:35.371 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:35.371 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:35.371 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:35.377 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:48:35.377 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:35.377 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:35.377 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:48:35.377 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:48:35.377 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:48:35.377 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:48:35.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.389703  9094 raft_consensus.cc:493] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:35.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.389981  9094 raft_consensus.cc:515] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.392449  9094 leader_election.cc:290] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468115402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:35.413 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:35.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:35.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:35.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:35.414 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:35.415 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:35.416 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:35.417 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:35.417 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:35.417 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
23:48:35.417 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:35.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:35.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:35.418 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:35.418 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:35.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.425940  8648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0ff57d18644a9285d2c0bca1167e06" candidate_uuid: "183b79dc80df4a9583cef13752304681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2100c738f2f94e4884d53e49614df1c4" is_pre_election: true
23:48:35.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.426455  8648 raft_consensus.cc:2468] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183b79dc80df4a9583cef13752304681 in term 0.
23:48:35.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.427202  8720 leader_election.cc:304] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.428269  9094 raft_consensus.cc:2804] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:35.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.428467  9094 raft_consensus.cc:493] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:35.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.428566  9094 raft_consensus.cc:3060] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.431182  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0ff57d18644a9285d2c0bca1167e06" candidate_uuid: "183b79dc80df4a9583cef13752304681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8" is_pre_election: true
23:48:35.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.431418  8922 raft_consensus.cc:2468] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183b79dc80df4a9583cef13752304681 in term 0.
23:48:35.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.432528  9094 raft_consensus.cc:515] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.434306  8648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0ff57d18644a9285d2c0bca1167e06" candidate_uuid: "183b79dc80df4a9583cef13752304681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2100c738f2f94e4884d53e49614df1c4"
23:48:35.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.434410  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0ff57d18644a9285d2c0bca1167e06" candidate_uuid: "183b79dc80df4a9583cef13752304681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:35.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.434557  8648 raft_consensus.cc:3060] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.434614  8922 raft_consensus.cc:3060] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.437795  8922 raft_consensus.cc:2468] T ff0ff57d18644a9285d2c0bca1167e06 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183b79dc80df4a9583cef13752304681 in term 1.
23:48:35.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.438532  8721 leader_election.cc:304] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 1fff25c44dbc403aa121b78bede605f8; no voters: 
23:48:35.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.438619  8648 raft_consensus.cc:2468] T ff0ff57d18644a9285d2c0bca1167e06 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183b79dc80df4a9583cef13752304681 in term 1.
23:48:35.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.438973  9094 leader_election.cc:290] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [CANDIDATE]: Term 1 election: Requested vote from peers 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.439258  9094 raft_consensus.cc:2804] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Leader election won for term 1
23:48:35.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.439604  9094 raft_consensus.cc:697] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [term 1 LEADER]: Becoming Leader. State: Replica: 183b79dc80df4a9583cef13752304681, State: Running, Role: LEADER
23:48:35.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.440431  9094 consensus_queue.cc:237] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.443 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [9ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.444 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [16ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.444 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30009), Traces: [0ms] sending RPC to server master-127.4.149.252:44265, [7ms] received response from server master-127.4.149.252:44265: OK, deferred=null) with no deferred attached!
23:48:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.449082  8467 catalog_manager.cc:5696] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 reported cstate change: term changed from 0 to 1, leader changed from <none> to 183b79dc80df4a9583cef13752304681 (127.8.22.194). New cstate: current_term: 1 leader_uuid: "183b79dc80df4a9583cef13752304681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } health_report { overall_health: UNKNOWN } } }
23:48:35.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.508653  9106 raft_consensus.cc:493] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:35.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.508895  9106 raft_consensus.cc:515] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.509660  9106 leader_election.cc:290] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.510162  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7c93703cbb4db6be37110dbd6d4d0b" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681" is_pre_election: true
23:48:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.510424  8785 raft_consensus.cc:2468] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.510426  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7c93703cbb4db6be37110dbd6d4d0b" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8" is_pre_election: true
23:48:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.510656  8922 raft_consensus.cc:2468] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.510947  8583 leader_election.cc:304] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.511317  9106 raft_consensus.cc:2804] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.511433  9106 raft_consensus.cc:493] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.511514  9106 raft_consensus.cc:3060] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.514744  9106 raft_consensus.cc:515] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.515530  9106 leader_election.cc:290] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Requested vote from peers 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.516225  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7c93703cbb4db6be37110dbd6d4d0b" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681"
23:48:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.516480  8785 raft_consensus.cc:3060] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.520213  8785 raft_consensus.cc:2468] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.520884  8583 leader_election.cc:304] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.521414  9106 raft_consensus.cc:2804] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Leader election won for term 1
23:48:35.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.522334  9106 raft_consensus.cc:697] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Running, Role: LEADER
23:48:35.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.522491  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7c93703cbb4db6be37110dbd6d4d0b" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:35.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.522742  8922 raft_consensus.cc:3060] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.522754  9106 consensus_queue.cc:237] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:35.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.525871  8922 raft_consensus.cc:2468] T fb7c93703cbb4db6be37110dbd6d4d0b P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.538009  8467 catalog_manager.cc:5696] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193). New cstate: current_term: 1 leader_uuid: "2100c738f2f94e4884d53e49614df1c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } health_report { overall_health: UNKNOWN } } }
23:48:35.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.550269  9106 consensus_queue.cc:1048] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:35.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.559563  9106 consensus_queue.cc:1048] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:35.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.565757  9108 consensus_queue.cc:1048] T 661b3ac37579429493abf420457e9e8a P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:35.592 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468115591 for job 6446e0085b210020482ce7a622d23630.
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.573330  9106 raft_consensus.cc:493] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.573560  9106 raft_consensus.cc:515] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.574307  9106 leader_election.cc:290] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601), 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.575264  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc02dfd5e5f4f678682f0beeac3a290" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8" is_pre_election: true
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.575618  8921 raft_consensus.cc:2468] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.578567  8584 leader_election.cc:304] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fff25c44dbc403aa121b78bede605f8, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.578893  9102 raft_consensus.cc:2804] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.578974  9102 raft_consensus.cc:493] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.579073  9102 raft_consensus.cc:3060] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.583195  9107 consensus_queue.cc:1048] T b4d3a334030d4353921fc9bde4b759f4 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.586615  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc02dfd5e5f4f678682f0beeac3a290" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681" is_pre_election: true
23:48:35.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.586944  8785 raft_consensus.cc:2468] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.587344  9106 raft_consensus.cc:493] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.587487  9106 raft_consensus.cc:515] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.588125  9106 leader_election.cc:290] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601), 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.588888  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055500fad9db4cffb040b3818af066b3" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8" is_pre_election: true
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.589102  8922 raft_consensus.cc:2468] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.589712  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055500fad9db4cffb040b3818af066b3" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681" is_pre_election: true
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.589830  8584 leader_election.cc:304] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fff25c44dbc403aa121b78bede605f8, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.589955  8785 raft_consensus.cc:2468] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 0.
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.590358  9106 raft_consensus.cc:2804] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.590477  9106 raft_consensus.cc:493] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.590586  9106 raft_consensus.cc:3060] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.593298  9102 raft_consensus.cc:515] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.597543  9102 leader_election.cc:290] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Requested vote from peers 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601), 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:35.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.598250  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc02dfd5e5f4f678682f0beeac3a290" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681"
23:48:35.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.598277  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cc02dfd5e5f4f678682f0beeac3a290" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:35.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.598491  8785 raft_consensus.cc:3060] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.598520  8920 raft_consensus.cc:3060] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.602247  8920 raft_consensus.cc:2468] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.602275  9106 raft_consensus.cc:515] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.603 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:35.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.604218  9106 leader_election.cc:290] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Requested vote from peers 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601), 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:35.609 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.603493  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055500fad9db4cffb040b3818af066b3" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fff25c44dbc403aa121b78bede605f8"
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.604990  8922 raft_consensus.cc:3060] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.604588  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "055500fad9db4cffb040b3818af066b3" candidate_uuid: "2100c738f2f94e4884d53e49614df1c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183b79dc80df4a9583cef13752304681"
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.605295  8784 raft_consensus.cc:3060] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 0 FOLLOWER]: Advancing to term 1
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.607093  8785 raft_consensus.cc:2468] T 4cc02dfd5e5f4f678682f0beeac3a290 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.607795  8583 leader_election.cc:304] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.608228  9106 raft_consensus.cc:2804] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Leader election won for term 1
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.608399  9106 raft_consensus.cc:697] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Running, Role: LEADER
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.608494  8922 raft_consensus.cc:2468] T 055500fad9db4cffb040b3818af066b3 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.609194  9106 consensus_queue.cc:237] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.610191  8584 leader_election.cc:304] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fff25c44dbc403aa121b78bede605f8, 2100c738f2f94e4884d53e49614df1c4; no voters: 
23:48:35.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.610504  9102 raft_consensus.cc:2804] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 1 FOLLOWER]: Leader election won for term 1
23:48:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.610677  9102 raft_consensus.cc:697] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [term 1 LEADER]: Becoming Leader. State: Replica: 2100c738f2f94e4884d53e49614df1c4, State: Running, Role: LEADER
23:48:35.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.610975  9102 consensus_queue.cc:237] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:35.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.618479  8784 raft_consensus.cc:2468] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2100c738f2f94e4884d53e49614df1c4 in term 1.
23:48:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.621580  8468 catalog_manager.cc:5696] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193). New cstate: current_term: 1 leader_uuid: "2100c738f2f94e4884d53e49614df1c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } health_report { overall_health: UNKNOWN } } }
23:48:35.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.638862  8468 catalog_manager.cc:5696] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193). New cstate: current_term: 1 leader_uuid: "2100c738f2f94e4884d53e49614df1c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } health_report { overall_health: UNKNOWN } } }
23:48:35.669 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:48:35.733 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:48:35.733 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:48:35.733 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:48:35.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:35.750 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:35.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.894286  9094 consensus_queue.cc:1048] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:35.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468115902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:35.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:35.910116  9094 consensus_queue.cc:1048] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:35.933 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=30 ms, finalizationTime=1 ms).
23:48:35.934 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
23:48:36.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:36.029889  9107 consensus_queue.cc:1048] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:36.056041  9108 consensus_queue.cc:1048] T 055500fad9db4cffb040b3818af066b3 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:36.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:36.089937  9108 consensus_queue.cc:1048] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:36.092 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468116091 for job 6446e0085b210020482ce7a622d23630.
23:48:36.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:36.108826  9102 consensus_queue.cc:1048] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:36.109 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
23:48:36.111 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
23:48:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:36.113571  9108 consensus_queue.cc:1048] T fb7c93703cbb4db6be37110dbd6d4d0b P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:36.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:36.125442  9106 consensus_queue.cc:1048] T 4cc02dfd5e5f4f678682f0beeac3a290 P 2100c738f2f94e4884d53e49614df1c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:36.216 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:36.217 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:36.217 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:36.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:36.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:36.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:36.217 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:36.217 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:36.218 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:36.218 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:36.218 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:36.218 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:36.218 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:36.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:36.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:36.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:36.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:36.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:36.344 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:36.344 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:36.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:36.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:36.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:36.345 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:36.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:36.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:36.345 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:36.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468116402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:36.413 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:36.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
23:48:36.541 [DEBUG - pool-44-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [3ms] received response from server master-127.3.230.252:37691: OK, deferred=null) with no deferred attached!
23:48:36.591 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468116591 for job 6446e0085b210020482ce7a622d23630.
23:48:36.602 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:36.603 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
23:48:36.616 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:36.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:36.795 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:48:36.811 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:36.832 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:36.842 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:48:36.859 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:48:36.866 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:48:36.867 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:48:36.867 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:48:36.868 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:48:36.868 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:48:36.868 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:48:36.868 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:48:36.868 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:36.869 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:36.869 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:36.869 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:36.869 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:36.870 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:36.870 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:48:36.870 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:48:36.870 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:48:36.870 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:48:36.870 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:48:36.870 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:36.870 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:36.870 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:36.871 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:36.871 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:36.871 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:36.871 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_f21f4f725037761b6c6e07be4b99a1af/blobStorage
23:48:36.871 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:39839 - max concurrent requests: 50 - max backlog: 1000
23:48:36.872 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_f21f4f725037761b6c6e07be4b99a1af/blobStorage
23:48:36.873 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_f21f4f725037761b6c6e07be4b99a1af/blobStorage
23:48:36.874 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:48:36.874 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: a4312e46-f932-4456-b154-6c9be007b3b6
23:48:36.876 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:48:36.877 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-0af666d2-7af0-46c3-b687-ef0e425f8776
23:48:36.878 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-7a8a5fcc-a2d5-454c-b19e-a213051b6939
23:48:36.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468116902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:36.918 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:48:36.920 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
23:48:37.056 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:48:37.056 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:48:37.056 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:48:37.056 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:48:37.057 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:48:37.059 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_12 .
23:48:37.063 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
23:48:37.064 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-51896b5f-0af8-48d3-915b-b5be8dc9b7cb
23:48:37.064 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:48:37.065 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:48:37.074 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:48:37.074 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:48:37.081 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:43147
23:48:37.081 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:48:37.084 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:43147 was granted leadership with leaderSessionID=8aba7ef6-fae2-48e9-9747-834c2ab090b6
23:48:37.084 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:43147 , session=8aba7ef6-fae2-48e9-9747-834c2ab090b6
23:48:37.084 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:48:37.084 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:48:37.084 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:48:37.085 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id d73f122c-af8f-4833-be5f-f441b1562ac0. Creating new DispatcherLeaderProcess.
23:48:37.085 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:48:37.091 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:48:37.091 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468117091 for job 6446e0085b210020482ce7a622d23630.
23:48:37.104 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:48:37.105 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:48:37.119 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_13 .
23:48:37.125 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 6446e0085b210020482ce7a622d23630 (4499 bytes, checkpointDuration=34 ms, finalizationTime=0 ms).
23:48:37.127 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
23:48:37.129 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_13 , session=d73f122c-af8f-4833-be5f-f441b1562ac0
23:48:37.131 [INFO - pool-117-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 0649e532-5632-4f4b-a386-fac2712fcd4a.
23:48:37.134 [INFO - pool-117-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_14 .
23:48:37.146 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
23:48:37.153 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:48:37.154 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:48:37.154 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:48:37.154 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:48:37.155 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_14 , session=0649e532-5632-4f4b-a386-fac2712fcd4a
23:48:37.156 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(a386fac2712fcd4a0649e53256324f4b).
23:48:37.176 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:37.181 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (86e770137b663b638a7b0ce49d5c917b).
23:48:37.182 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (86e770137b663b638a7b0ce49d5c917b).
23:48:37.182 [INFO - flink-pekko.actor.default-dispatcher-5] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-86e770137b663b638a7b0ce49d5c917b'.
23:48:37.182 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 86e770137b663b638a7b0ce49d5c917b was granted leadership with leader id a271039a-33da-44fc-8cca-930bc30cb0d0. Creating new JobMasterServiceProcess.
23:48:37.185 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_15 .
23:48:37.187 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID a4312e46-f932-4456-b154-6c9be007b3b6 (pekko://flink/user/rpc/taskmanager_12) at ResourceManager
23:48:37.188 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_14 under registration id 4445f77f72a065bfd64dabfc11a5af11.
23:48:37.189 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:344) Registering task executor a4312e46-f932-4456-b154-6c9be007b3b6 under 4445f77f72a065bfd64dabfc11a5af11 at the slot manager.
23:48:37.190 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (86e770137b663b638a7b0ce49d5c917b).
23:48:37.190 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (86e770137b663b638a7b0ce49d5c917b).
23:48:37.191 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 40850a88b517955b2a1f2087427d3127 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.192 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (86e770137b663b638a7b0ce49d5c917b).
23:48:37.192 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:48:37.193 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
23:48:37.193 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6154a2be
23:48:37.193 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:37.193 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:48:37.195 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:48:37.195 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@472c9fea for Flink Streaming Job (86e770137b663b638a7b0ce49d5c917b).
23:48:37.196 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_15 , session=a271039a-33da-44fc-8cca-930bc30cb0d0
23:48:37.197 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (86e770137b663b638a7b0ce49d5c917b) under job master id 8cca930bc30cb0d0a271039a33da44fc.
23:48:37.197 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:48:37.199 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.199 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:48:37.200 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (86e770137b663b638a7b0ce49d5c917b) switched from state CREATED to RUNNING.
23:48:37.202 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:48:37.203 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:48:37.204 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:48:37.204 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:37.204 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:48:37.205 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:37.205 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(a386fac2712fcd4a0649e53256324f4b)
23:48:37.205 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:37.205 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.104.125:36473(127.7.104.125:36473)] Successfully connected to peer
23:48:37.207 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.104.126:33577(127.7.104.126:33577)] Successfully connected to peer
23:48:37.209 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.126
23:48:37.211 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:37.211 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager 8cca930bc30cb0d0a271039a33da44fc@pekko://flink/user/rpc/jobmanager_15 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.216 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.125
23:48:37.217 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1015) Registered job manager 8cca930bc30cb0d0a271039a33da44fc@pekko://flink/user/rpc/jobmanager_15 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.219 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.104.124:39307(127.7.104.124:39307)] Successfully connected to peer
23:48:37.227 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.227 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.227 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a386fac2712fcd4a0649e53256324f4b.
23:48:37.228 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:37.229 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.124
23:48:37.232 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8cf6e70b, L:/127.0.0.1:60984 - R:/127.7.104.125:36473] using SASL/PLAIN
23:48:37.233 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf6ade987, L:/127.0.0.1:46000 - R:/127.7.104.126:33577] using SASL/PLAIN
23:48:37.235 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:37.236 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [31ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: OK, [32ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: OK, deferred=null) after lookup
23:48:37.239 [DEBUG - main] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:48:37.239 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:37.240 [DEBUG - main] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:48:37.241 [DEBUG - main] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:48:37.241 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.8.22.252:44235(127.8.22.252:44235)] Successfully connected to peer
23:48:37.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:37.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:37.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:37.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.243 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.243 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:37.249 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.251 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8bd3975b, L:/127.0.0.1:34556 - R:/127.7.104.124:39307] using SASL/PLAIN
23:48:37.256 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.8.22.253:33181(127.8.22.253:33181)] Successfully connected to peer
23:48:37.257 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 86e770137b663b638a7b0ce49d5c917b
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager a4312e46-f932-4456-b154-6c9be007b3b6
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:48:37.258 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d429ceb379d5f3f058dc43e23b4a2944 from a4312e46-f932-4456-b154-6c9be007b3b6 for job 86e770137b663b638a7b0ce49d5c917b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.259 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 383e749a8070e650d1910d83d140e065 from a4312e46-f932-4456-b154-6c9be007b3b6 for job 86e770137b663b638a7b0ce49d5c917b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.259 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request d429ceb379d5f3f058dc43e23b4a2944 for job 86e770137b663b638a7b0ce49d5c917b from resource manager with leader id a386fac2712fcd4a0649e53256324f4b.
23:48:37.259 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for d429ceb379d5f3f058dc43e23b4a2944 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.260 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 9fa644f0eaa1cd27a604255cca1b4463 from a4312e46-f932-4456-b154-6c9be007b3b6 for job 86e770137b663b638a7b0ce49d5c917b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.260 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 2b79afe5d7cdb3b70c9ef47bd55ef49b from a4312e46-f932-4456-b154-6c9be007b3b6 for job 86e770137b663b638a7b0ce49d5c917b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.262 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.252
23:48:37.262 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.253
23:48:37.263 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.8.22.254:45201(127.8.22.254:45201)] Successfully connected to peer
23:48:37.264 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:192) Add job 86e770137b663b638a7b0ce49d5c917b for job leader monitoring.
23:48:37.264 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 383e749a8070e650d1910d83d140e065 for job 86e770137b663b638a7b0ce49d5c917b from resource manager with leader id a386fac2712fcd4a0649e53256324f4b.
23:48:37.265 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 383e749a8070e650d1910d83d140e065 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.265 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 9fa644f0eaa1cd27a604255cca1b4463 for job 86e770137b663b638a7b0ce49d5c917b from resource manager with leader id a386fac2712fcd4a0649e53256324f4b.
23:48:37.265 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 9fa644f0eaa1cd27a604255cca1b4463 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.266 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 2b79afe5d7cdb3b70c9ef47bd55ef49b for job 86e770137b663b638a7b0ce49d5c917b from resource manager with leader id a386fac2712fcd4a0649e53256324f4b.
23:48:37.266 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 2b79afe5d7cdb3b70c9ef47bd55ef49b with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:37.266 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_15 with leader id a271039a-33da-44fc-8cca-930bc30cb0d0.
23:48:37.268 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:48:37.270 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_15 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.270 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.270 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.271 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:48:37.271 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id 9fa644f0eaa1cd27a604255cca1b4463
23:48:37.272 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9fa644f0eaa1cd27a604255cca1b4463.
23:48:37.273 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.254
23:48:37.274 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.275 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.275 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.275 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:48:37.275 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:48:37.275 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 86e770137b663b638a7b0ce49d5c917b
23:48:37.275 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id 383e749a8070e650d1910d83d140e065
23:48:37.276 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:48:37.276 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id 2b79afe5d7cdb3b70c9ef47bd55ef49b
23:48:37.277 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:48:37.277 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id d429ceb379d5f3f058dc43e23b4a2944
23:48:37.277 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc03d335a, L:/127.0.0.1:57340 - R:/127.8.22.252:44235] using SASL/PLAIN
23:48:37.278 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 9fa644f0eaa1cd27a604255cca1b4463.
23:48:37.279 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x700c1c21, L:/127.0.0.1:37552 - R:/127.8.22.253:33181] using SASL/PLAIN
23:48:37.280 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:48:37.280 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:48:37.280 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 383e749a8070e650d1910d83d140e065.
23:48:37.281 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:37.281 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=42), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.252:44235, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.253:33181, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.254:45201, [42ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.252:44235: OK, deferred=null) after lookup
23:48:37.282 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 383e749a8070e650d1910d83d140e065.
23:48:37.284 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:48:37.284 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:48:37.284 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2b79afe5d7cdb3b70c9ef47bd55ef49b.
23:48:37.284 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.285 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a381f6a
23:48:37.285 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:37.285 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:48:37.285 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:37.286 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:37.288 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 661b3ac37579429493abf420457e9e8a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:37.288 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4cc02dfd5e5f4f678682f0beeac3a290 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:37.289 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 055500fad9db4cffb040b3818af066b3 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:37.289 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.289 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.289 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.289 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=661b3ac37579429493abf420457e9e8a@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=4cc02dfd5e5f4f678682f0beeac3a290@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=055500fad9db4cffb040b3818af066b3@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.289 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.8.22.252:44235, [3ms] Sub RPC GetTableLocations: received response from server master-127.8.22.252:44235: OK, deferred=null)) after lookup
23:48:37.290 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] connecting to peer
23:48:37.291 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 2b79afe5d7cdb3b70c9ef47bd55ef49b.
23:48:37.293 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] Successfully connected to peer
23:48:37.296 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5480223b
23:48:37.296 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.298 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd8d52203, L:/127.0.0.1:36386 - R:/127.8.22.254:45201] using SASL/PLAIN
23:48:37.302 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.303 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9fa644f0eaa1cd27a604255cca1b4463.
23:48:37.303 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:48:37.303 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 383e749a8070e650d1910d83d140e065.
23:48:37.303 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:48:37.303 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2b79afe5d7cdb3b70c9ef47bd55ef49b.
23:48:37.303 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot d429ceb379d5f3f058dc43e23b4a2944.
23:48:37.304 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot d429ceb379d5f3f058dc43e23b4a2944.
23:48:37.305 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e6dd678
23:48:37.305 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:37.305 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id d429ceb379d5f3f058dc43e23b4a2944.
23:48:37.305 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:48:37.306 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:37.306 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:37.309 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@153cad1
23:48:37.309 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:37.311 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:48:37.311 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:48:37.311 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:48:37.311 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:48:37.311 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:37.309 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5388c159
23:48:37.311 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@451160e4
23:48:37.312 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:37.312 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:37.312 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:48:37.312 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:37.312 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:37.314 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.316 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@368952b2
23:48:37.319 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c442455
23:48:37.319 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.320 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:48:37.321 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.325 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:48:37.326 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.8.22.252:44235(127.8.22.252:44235)] Successfully connected to peer
23:48:37.327 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.252
23:48:37.333 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.336 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.336 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc71c7c13, L:/127.0.0.1:38040 - R:/127.8.22.193:34899] using TOKEN/null
23:48:37.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:37.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:37.337 [DEBUG - pool-78-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:37.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:37.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:37.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:37.338 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:37.338 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:37.338 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:37.338 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:37.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:37.338 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:37.340 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:37.341 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=26231, elapsed=25023), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [22ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [424ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1284ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1619ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1622ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3644ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6580ms] refreshing cache from master, [6580ms] too many traces: truncated at 100 traces, deferred=Deferred@123080918(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447)))
23:48:37.342 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, attempt=12, KuduRpc(method=Scan, tablet=f80c95fd8a794a1cb78e9c76d2f2a6cc, attempt=12, TimeoutTracker(timeout=30000, elapsed=28794), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [276ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511], [276ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf36adf95, L:/127.0.0.1:35508 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [472ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625], [472ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x241b591c, L:/127.0.0.1:49026 - R:/127.3.230.194:45625], [480ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [674ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: connection closed, [674ms] delaying RPC due to: Network error: connection closed, [680ms] refreshing cache from master, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [767ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [799ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [800ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [803ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [806ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [819ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [819ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [860ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [864ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [864ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [880ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [881ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [881ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [960ms] refreshing cache from master, [960ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [963ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [964ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [965ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [965ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [1440ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [1442ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [1442ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [1840ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [1842ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [1842ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [3760ms] refreshing cache from master, [3760ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [3762ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3762ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3779ms] Sub RPC GetTableLocations: refreshing cache from master, [3779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3781ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3781ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3782ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3782ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3800ms] Sub RPC GetTableLocations: refreshing cache from master, [3800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3803ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3804ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3805ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3805ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3820ms] Sub RPC GetTableLocations: refreshing cache from master, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3822ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3824ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3824ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3824ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3841ms] Sub RPC GetTableLocations: refreshing cache from master, [3842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3843ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3844ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3845ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3845ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3846ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3860ms] Sub RPC GetTableLocations: refreshing cache from master, [3860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3862ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3864ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3864ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3879ms] Sub RPC GetTableLocations: refreshing cache from master, [3880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3882ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3883ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3883ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3883ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3919ms] Sub RPC GetTableLocations: refreshing cache from master, [3919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3921ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3922ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [4179ms] Sub RPC GetTableLocations: refreshing cache from master, [4180ms] too many traces: truncated at 100 traces, deferred=Deferred@107630981(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0 -> (continuation of Deferred@493772215 after retry RPC@1031630220) -> (continuation of Deferred@722115815 after retry RPC@1919618885), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0 -> (continuation of Deferred@493772215 after retry RPC@1031630220) -> (continuation of Deferred@722115815 after retry RPC@1919618885)))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=26231, elapsed=25023), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [22ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [424ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1284ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1619ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1622ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3644ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6580ms] refreshing cache from master, [6580ms] too many traces: truncated at 100 traces, deferred=Deferred@123080918(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.347 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=26231, elapsed=25023), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [22ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [424ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1284ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1619ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1622ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3644ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6580ms] refreshing cache from master, [6580ms] too many traces: truncated at 100 traces, deferred=Deferred@123080918(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.346 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:48:37.348 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
23:48:37.348 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=26231, elapsed=25023), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [22ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [424ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1284ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1619ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1622ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3644ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6580ms] refreshing cache from master, [6580ms] too many traces: truncated at 100 traces, deferred=Deferred@123080918(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.349 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] disconnecting while in state TERMINATED
23:48:37.349 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.3.230.254:44025(127.3.230.254:44025)] disconnecting while in state TERMINATED
23:48:37.349 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.3.230.252:37691(127.3.230.252:37691)] disconnecting while in state TERMINATED
23:48:37.349 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state TERMINATED
23:48:37.349 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.3.230.253:41003(127.3.230.253:41003)] disconnecting while in state TERMINATED
23:48:37.350 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] disconnecting while in state TERMINATED
23:48:37.350 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.350 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbb11d3bb, L:/127.0.0.1:57350 - R:/127.8.22.252:44235] using SASL/PLAIN
23:48:37.350 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.4.149.252:44265(127.4.149.252:44265)] disconnecting while in state TERMINATED
23:48:37.350 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.4.149.253:38083(127.4.149.253:38083)] disconnecting while in state TERMINATED
23:48:37.350 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 7 thread-local buffer(s) from thread: kudu-nio-2
23:48:37.350 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] disconnecting while in state TERMINATED
23:48:37.350 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.4.149.254:41393(127.4.149.254:41393)] disconnecting while in state TERMINATED
23:48:37.351 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:37.351 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-4
23:48:37.351 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
23:48:37.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.351 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
23:48:37.352 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 15 thread-local buffer(s) from thread: kudu-nio-1
23:48:37.352 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
23:48:37.352 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 8 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.352 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
23:48:37.352 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.355 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:48:37.356 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.8.22.253:33181(127.8.22.253:33181)] Successfully connected to peer
23:48:37.357 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.357 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:37.358 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.253
23:48:37.361 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.362 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:37.366 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.366 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:37.368 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:48:37.370 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:48:37.370 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:37.371 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.371 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:37.375 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.376 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.8.22.252:44235(127.8.22.252:44235)] Successfully connected to peer
23:48:37.377 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.378 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:37.378 [DEBUG - main] (Connection.java:748) [peer 183b79dc80df4a9583cef13752304681(127.8.22.194:33843)] connecting to peer
23:48:37.379 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2b8d9c1c, L:/127.0.0.1:37564 - R:/127.8.22.253:33181] using SASL/PLAIN
23:48:37.380 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:48:37.380 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.252
23:48:37.385 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.8.22.253:33181(127.8.22.253:33181)] Successfully connected to peer
23:48:37.387 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.8.22.254:45201(127.8.22.254:45201)] Successfully connected to peer
23:48:37.389 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.253
23:48:37.389 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.393 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:48:37.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:37.394 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.254
23:48:37.394 [WARN - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=26231, elapsed=25023), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [22ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [424ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1284ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1619ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1622ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3644ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6580ms] refreshing cache from master, [6580ms] too many traces: truncated at 100 traces, deferred=Deferred@123080918(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.395 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:48:37.398 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
23:48:37.400 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7939c85c, L:/127.0.0.1:57364 - R:/127.8.22.252:44235] using SASL/PLAIN
23:48:37.402 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468117402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:37.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:37.405 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=26231, elapsed=25023), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [22ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [424ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1284ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1619ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1622ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3644ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6580ms] refreshing cache from master, [6580ms] too many traces: truncated at 100 traces, deferred=Deferred@123080918(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@617339881 after retry RPC after error@295095495) -> (continuation of Deferred@1980666715 after retry RPC after error@1097465324) -> (continuation of Deferred@998732475 after retry RPC after error@483418616) -> (continuation of Deferred@516341106 after retry RPC after error@273593819) -> (continuation of Deferred@282861507 after retry RPC after error@261907329) -> (continuation of Deferred@605712941 after retry RPC after error@1092614936) -> (continuation of Deferred@835569407 after retry RPC after error@1562454828) -> (continuation of Deferred@710783423 after retry RPC after error@346314967) -> (continuation of Deferred@1258393218 after retry RPC after error@523084933) -> (continuation of Deferred@1488596630 after retry RPC after error@1852749750) -> (continuation of Deferred@702304615 after retry RPC after error@1529332053) -> (continuation of Deferred@1390451257 after retry RPC after error@1227375828) -> (continuation of Deferred@36991999 after retry RPC after error@1736193925) -> (continuation of Deferred@823875585 after retry RPC after error@975090706) -> (continuation of Deferred@454333221 after retry RPC after error@491937757) -> (continuation of Deferred@1986189094 after retry RPC after error@957567964) -> (continuation of Deferred@111239776 after retry RPC after error@159545822) -> (continuation of Deferred@1773753391 after retry RPC after error@1251436407) -> (continuation of Deferred@1193848359 after retry RPC after error@1576956821) -> (continuation of Deferred@2118470697 after retry RPC after error@261627977) -> (continuation of Deferred@222559755 after retry RPC after error@596592365) -> (continuation of Deferred@2004841137 after retry RPC after error@967544447)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.406 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
23:48:37.406 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
23:48:37.406 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state RUNNING to RESTARTING.
23:48:37.405 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=90), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.252:44235, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.253:33181, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.254:45201, [78ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.252:44235: OK, deferred=null) after lookup
23:48:37.407 [WARN - flink-pekko.actor.default-dispatcher-7] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
23:48:37.407 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:37.410 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.410 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.411 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:37.412 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:48:37.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
23:48:37.414 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xac886fc5, L:/127.0.0.1:37580 - R:/127.8.22.253:33181] using SASL/PLAIN
23:48:37.415 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.8.22.252:44235(127.8.22.252:44235)] Successfully connected to peer
23:48:37.417 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.252
23:48:37.417 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.418 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.419 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@67361ac6
23:48:37.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:48:37.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:48:37.422 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:48:37.423 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.8.22.253:33181(127.8.22.253:33181)] Successfully connected to peer
23:48:37.425 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.253
23:48:37.425 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5c142ef2, L:/127.0.0.1:36392 - R:/127.8.22.254:45201] using SASL/PLAIN
23:48:37.432 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.8.22.254:45201(127.8.22.254:45201)] Successfully connected to peer
23:48:37.433 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.435 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.254
23:48:37.441 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2b8ff564, L:/127.0.0.1:57378 - R:/127.8.22.252:44235] using SASL/PLAIN
23:48:37.444 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:48:37.445 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:37.448 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.449 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.8.22.252:44235(127.8.22.252:44235)] Successfully connected to peer
23:48:37.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=124), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.252:44235, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.253:33181, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.254:45201, [77ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.252:44235: OK, deferred=null) after lookup
23:48:37.452 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.453 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.252
23:48:37.456 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.457 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7968280d
23:48:37.458 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:48:37.458 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:48:37.458 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:48:37.459 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.8.22.253:33181(127.8.22.253:33181)] Successfully connected to peer
23:48:37.461 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd8841639, L:/127.0.0.1:37596 - R:/127.8.22.253:33181] using SASL/PLAIN
23:48:37.463 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.253
23:48:37.464 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.465 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.8.22.254:45201(127.8.22.254:45201)] Successfully connected to peer
23:48:37.471 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.8.22.254
23:48:37.472 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xcf48dfad, L:/127.0.0.1:36398 - R:/127.8.22.254:45201] using SASL/PLAIN
23:48:37.473 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:37.474 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=171), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.252:44235, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.253:33181, [42ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.252:44235: OK, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.254:45201, [72ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.253:33181: OK, deferred=null) after lookup
23:48:37.476 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.476 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.8.22.254:45201(127.8.22.254:45201)] Successfully connected to peer
23:48:37.480 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.480 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@a06062
23:48:37.481 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.482 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:48:37.482 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:48:37.484 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb3a040ef, L:/127.0.0.1:37604 - R:/127.8.22.253:33181] using SASL/PLAIN
23:48:37.486 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.487 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.490 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xde99b16a, L:/127.0.0.1:36406 - R:/127.8.22.254:45201] using SASL/PLAIN
23:48:37.491 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x997e4bb7, L:/127.0.0.1:57394 - R:/127.8.22.252:44235] using SASL/PLAIN
23:48:37.496 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:37.496 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=176), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.252:44235, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.253:33181, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.8.22.254:45201, [139ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.253:33181: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.254:45201: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.8.22.252:44235: OK, deferred=null) after lookup
23:48:37.503 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:37.504 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e0a19fcb59fb6c5dbdd8ed96d5a77e3bbddc74f19d91ac451a087440dd2db689'}]
23:48:37.506 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.510 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:37.511 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.514 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.516 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:37.516 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:37.516 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:37.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:37.516 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:37.517 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:37.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:37.517 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:37.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:37.517 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:37.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:37.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:37.517 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:37.518 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:37.518 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@59ba4238
23:48:37.519 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7b1d3e7f, L:/127.0.0.1:36418 - R:/127.8.22.254:45201] using TOKEN/null
23:48:37.520 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:48:37.520 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:48:37.535 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:37.536 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6185841dd57c2ef7f71e0752c798465208c57c880df5820fde6f0b678342f852'}]
23:48:37.538 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.539 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:37.540 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}]
23:48:37.540 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:37.541 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:37.542 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 183b79dc80df4a9583cef13752304681(127.8.22.194:33843)] Successfully connected to peer
23:48:37.543 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:37.543 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='43fc80f433a3e9d47fb499aff2f2164138bc87e68eb187680022ce326fe38e7c'}]
23:48:37.545 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.550 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:37.551 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}]
23:48:37.556 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:37.557 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.561 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xb6ebf0d7, L:/127.0.0.1:49064 - R:/127.8.22.194:33843] using TOKEN/null
23:48:37.563 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:37.564 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:37.575 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:37.577 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:37.582 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.582 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:37.600 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:37.603 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:37.604 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e940cff2ef578f9685e1d0c8e9c7656e7e6479d881d483f9f1bdbbdc9f98281b'}]
23:48:37.606 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.607 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:37.611 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:37.611 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:37.612 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:37.622 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:37.623 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:37.623 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:37.623 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:37.623 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:37.623 [DEBUG - pool-74-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:37.624 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:37.624 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:37.624 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:37.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:37.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:37.625 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:37.625 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:37.626 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=22, TimeoutTracker(timeout=27119, elapsed=26203), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [24ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [283ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [445ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [446ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [446ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [763ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [764ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [765ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [863ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1984ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1985ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1985ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3621ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3624ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3760ms] refreshing cache from master, [3760ms] too many traces: truncated at 100 traces, deferred=Deferred@1805039294(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716)))
23:48:37.627 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=ad1717b59e6a4882bde027a3330b8294, attempt=12, KuduRpc(method=Scan, tablet=ad1717b59e6a4882bde027a3330b8294, attempt=12, TimeoutTracker(timeout=30000, elapsed=29085), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [290ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511], [291ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xec4e0296, L:/127.0.0.1:35498 - R:/127.3.230.193:42511], [301ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [487ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625], [487ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x5140cc84, L:/127.0.0.1:49050 - R:/127.3.230.194:45625], [501ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [690ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473], [690ms] delaying RPC due to: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0x10077c19, L:/127.0.0.1:48886 - R:/127.3.230.195:35473], [701ms] refreshing cache from master, [701ms] Sub RPC GetTableLocations: refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [793ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [799ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [804ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [805ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [831ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [831ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [861ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [863ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [863ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [920ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [922ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [922ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [1061ms] refreshing cache from master, [1061ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [1064ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [1070ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [1072ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [1072ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [1240ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [1242ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [1242ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [2021ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [2023ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [2023ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [2880ms] refreshing cache from master, [2880ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [2882ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2882ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2900ms] Sub RPC GetTableLocations: refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2903ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2903ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2904ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2904ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2921ms] Sub RPC GetTableLocations: refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2925ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2941ms] Sub RPC GetTableLocations: refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2943ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2943ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2943ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2944ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2960ms] Sub RPC GetTableLocations: refreshing cache from master, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2963ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2963ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2980ms] Sub RPC GetTableLocations: refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2983ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3040ms] Sub RPC GetTableLocations: refreshing cache from master, [3040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3041ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3041ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3042ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3042ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3160ms] Sub RPC GetTableLocations: refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3163ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3321ms] Sub RPC GetTableLocations: refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3322ms] too many traces: truncated at 100 traces, deferred=Deferred@627825512(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@1047500630 after retry RPC@1970880732) -> (continuation of Deferred@792688707 after retry RPC@527688981), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0 -> (continuation of Deferred@1047500630 after retry RPC@1970880732) -> (continuation of Deferred@792688707 after retry RPC@527688981)))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=22, TimeoutTracker(timeout=27119, elapsed=26203), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [24ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [283ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [445ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [446ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [446ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [763ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [764ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [765ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [863ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1984ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1985ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1985ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3621ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3624ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3760ms] refreshing cache from master, [3760ms] too many traces: truncated at 100 traces, deferred=Deferred@1805039294(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.627 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=22, TimeoutTracker(timeout=27119, elapsed=26203), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [24ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [283ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [445ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [446ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [446ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [763ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [764ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [765ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [863ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1984ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1985ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1985ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3621ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3624ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3760ms] refreshing cache from master, [3760ms] too many traces: truncated at 100 traces, deferred=Deferred@1805039294(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.627 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.628 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
23:48:37.628 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=22, TimeoutTracker(timeout=27119, elapsed=26203), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [24ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [283ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [445ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [446ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [446ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [763ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [764ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [765ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [863ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1984ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1985ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1985ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3621ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3624ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3760ms] refreshing cache from master, [3760ms] too many traces: truncated at 100 traces, deferred=Deferred@1805039294(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] disconnecting while in state TERMINATED
23:48:37.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.3.230.254:44025(127.3.230.254:44025)] disconnecting while in state TERMINATED
23:48:37.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.3.230.252:37691(127.3.230.252:37691)] disconnecting while in state TERMINATED
23:48:37.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state TERMINATED
23:48:37.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.3.230.253:41003(127.3.230.253:41003)] disconnecting while in state TERMINATED
23:48:37.629 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] disconnecting while in state TERMINATED
23:48:37.629 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.630 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.4.149.252:44265(127.4.149.252:44265)] disconnecting while in state TERMINATED
23:48:37.630 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.4.149.253:38083(127.4.149.253:38083)] disconnecting while in state TERMINATED
23:48:37.630 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.4.149.254:41393(127.4.149.254:41393)] disconnecting while in state TERMINATED
23:48:37.630 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 086235c2e9fa4599aedd1f42dea78812(127.4.149.194:34185)] disconnecting while in state TERMINATED
23:48:37.630 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 15 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.630 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.630 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-1
23:48:37.630 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:37.631 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:48:37.631 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-4
23:48:37.631 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.631 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-5
23:48:37.630 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-2
23:48:37.631 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:37.632 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-3
23:48:37.633 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x234f83b3, L:/127.0.0.1:57576 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:37.645 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:37.646 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:37.650 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:37.650 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.650 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:37.654 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.655 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:37.658 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.659 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:37.663 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.663 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:37.667 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.668 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085408063488001) for scanner KuduScanner(table=replication_test_table, tablet=0dd39db2759a4265b52a1bcd82c9b355, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.668 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:37.668 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [6185841dd57c2ef7f71e0752c798465208c57c880df5820fde6f0b678342f852]
23:48:37.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6185841dd57c2ef7f71e0752c798465208c57c880df5820fde6f0b678342f852]
23:48:37.669 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:37.669 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:37.670 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6185841dd57c2ef7f71e0752c798465208c57c880df5820fde6f0b678342f852 finished by subtask 1; deferring removal (restored in pending)
23:48:37.671 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:37.672 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a977b933d3a915a4c35e72dced75cab9bb2d8bf3762d69ba79fe5cd7ce3cef25'}]
23:48:37.675 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.675 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:37.678 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.682 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.687 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfbd9e87a, L:/127.0.0.1:57592 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:37.689 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:37.703 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.708 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2bd9ac5b, L:/127.0.0.1:57608 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:37.708 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7305085408063488001) for scanner KuduScanner(table=replication_test_table, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.709 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [43fc80f433a3e9d47fb499aff2f2164138bc87e68eb187680022ce326fe38e7c]
23:48:37.710 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:37.718 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 661b3ac37579429493abf420457e9e8a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:37.718 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 4cc02dfd5e5f4f678682f0beeac3a290 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:37.718 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 055500fad9db4cffb040b3818af066b3 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:37.718 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.718 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.718 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.718 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085408063488001) for scanner KuduScanner(table=replication_test_table, tablet=f4f3a8a917ec4959bafa5da9932eb932, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.719 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=661b3ac37579429493abf420457e9e8a@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=4cc02dfd5e5f4f678682f0beeac3a290@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=055500fad9db4cffb040b3818af066b3@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.719 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [e0a19fcb59fb6c5dbdd8ed96d5a77e3bbddc74f19d91ac451a087440dd2db689]
23:48:37.719 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e0a19fcb59fb6c5dbdd8ed96d5a77e3bbddc74f19d91ac451a087440dd2db689]
23:48:37.720 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:37.720 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:37.721 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e0a19fcb59fb6c5dbdd8ed96d5a77e3bbddc74f19d91ac451a087440dd2db689 finished by subtask 0; deferring removal (restored in pending)
23:48:37.721 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:37.722 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [43fc80f433a3e9d47fb499aff2f2164138bc87e68eb187680022ce326fe38e7c]
23:48:37.722 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0472db9478e0ae13a1f70efabb5dcfa2d717f12a5d0c60ce15706f4663498016'}]
23:48:37.723 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.723 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.723 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:37.725 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:37.728 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.728 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:37.728 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 43fc80f433a3e9d47fb499aff2f2164138bc87e68eb187680022ce326fe38e7c finished by subtask 2; deferring removal (restored in pending)
23:48:37.729 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:37.729 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:37.729 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:37.729 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.730 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:37.733 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.733 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:37.734 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
23:48:37.734 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:37.735 [WARN - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=22, TimeoutTracker(timeout=27119, elapsed=26203), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [24ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [283ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [445ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [446ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [446ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [763ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [764ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [765ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [863ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1984ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1985ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1985ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3621ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3624ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3760ms] refreshing cache from master, [3760ms] too many traces: truncated at 100 traces, deferred=Deferred@1805039294(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.736 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:48:37.739 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.739 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:48:37.739 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:37.743 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=22, TimeoutTracker(timeout=27119, elapsed=26203), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [24ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [283ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [283ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [445ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [446ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [446ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [763ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [764ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [765ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [863ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1980ms] refreshing cache from master, [1980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1984ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1985ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1985ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3621ms] refreshing cache from master, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3624ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [3760ms] refreshing cache from master, [3760ms] too many traces: truncated at 100 traces, deferred=Deferred@1805039294(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1664355438 after retry RPC after error@459304878) -> (continuation of Deferred@1574671803 after retry RPC after error@52886520) -> (continuation of Deferred@1085456526 after retry RPC after error@1488439849) -> (continuation of Deferred@1497430729 after retry RPC after error@1829577506) -> (continuation of Deferred@997009597 after retry RPC after error@1567447931) -> (continuation of Deferred@52786349 after retry RPC after error@120931288) -> (continuation of Deferred@1439677251 after retry RPC after error@1649312770) -> (continuation of Deferred@1248204026 after retry RPC after error@1734387181) -> (continuation of Deferred@1331498977 after retry RPC after error@1495657628) -> (continuation of Deferred@589230726 after retry RPC after error@1102279877) -> (continuation of Deferred@1723222293 after retry RPC after error@268507219) -> (continuation of Deferred@1147097623 after retry RPC after error@504365829) -> (continuation of Deferred@1253707571 after retry RPC after error@1382110647) -> (continuation of Deferred@1821403654 after retry RPC after error@1921406138) -> (continuation of Deferred@1751064142 after retry RPC after error@810230303) -> (continuation of Deferred@1608826442 after retry RPC after error@520557192) -> (continuation of Deferred@263897672 after retry RPC after error@1720210042) -> (continuation of Deferred@484750863 after retry RPC after error@1003512905) -> (continuation of Deferred@1646348793 after retry RPC after error@1184816197) -> (continuation of Deferred@2138267223 after retry RPC after error@1194954716)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:37.745 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:48:37.744 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:37.746 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:48:37.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:37.746 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:37.746 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
23:48:37.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:37.750 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.751 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:37.763 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:37.763 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:37.764 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.764 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:37.796 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:37.798 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:37.802 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:37.808 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.808 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:37.813 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.813 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:37.818 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.818 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:37.823 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.823 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:37.827 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.827 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:37.831 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:37.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:37.832 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.832 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.832 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:37.832 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:37.842 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:37.844 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:37.853 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:37.862 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:37.865 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:37.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468117869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:37.872 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=253, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@a4b7b6f, flushNotification=Deferred@2071821115(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:37.873 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] connecting to peer
23:48:37.876 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:37.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:37.876 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.879 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:37.882 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.885 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.886 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.887 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:37.891 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.891 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:37.898 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.898 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:37.902 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.902 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:37.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468117902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:37.905 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x75efeacb, L:/127.0.0.1:57624 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:37.906 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.907 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:37.911 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.911 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:37.915 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa4c6c2df, L:/127.0.0.1:57630 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:37.927 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:37.928 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
23:48:37.930 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
23:48:37.930 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7305085408063488001) for scanner KuduScanner(table=replication_test_table, tablet=4238b4248ecd495d9d7fe29bf37abc0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.931 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [e940cff2ef578f9685e1d0c8e9c7656e7e6479d881d483f9f1bdbbdc9f98281b]
23:48:37.932 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:37.932 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:37.932 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085408063488001) for scanner KuduScanner(table=replication_test_table, tablet=0a7473c87ce1473fab3709d68c863dcd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.936 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [a977b933d3a915a4c35e72dced75cab9bb2d8bf3762d69ba79fe5cd7ce3cef25]
23:48:37.937 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.938 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.938 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.938 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.940 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.940 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.940 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.940 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.940 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e940cff2ef578f9685e1d0c8e9c7656e7e6479d881d483f9f1bdbbdc9f98281b]
23:48:37.940 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.941 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.941 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.941 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.941 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e940cff2ef578f9685e1d0c8e9c7656e7e6479d881d483f9f1bdbbdc9f98281b finished by subtask 3; deferring removal (restored in pending)
23:48:37.941 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:37.941 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:37.941 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.941 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.941 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:37.942 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.942 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.942 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.942 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.942 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.942 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.943 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:37.943 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:37.943 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:37.943 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:37.944 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.955 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a977b933d3a915a4c35e72dced75cab9bb2d8bf3762d69ba79fe5cd7ce3cef25]
23:48:37.955 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:37.955 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:37.956 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:37.957 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a977b933d3a915a4c35e72dced75cab9bb2d8bf3762d69ba79fe5cd7ce3cef25 finished by subtask 1; deferring removal (restored in pending)
23:48:37.957 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.960 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:37.963 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9a623dac, L:/127.0.0.1:57646 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:37.971 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] Successfully connected to peer
23:48:37.975 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085408063488001) for scanner KuduScanner(table=replication_test_table, tablet=50339fc54f264099966359f5cbc63947, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.976 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [0472db9478e0ae13a1f70efabb5dcfa2d717f12a5d0c60ce15706f4663498016]
23:48:37.976 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0472db9478e0ae13a1f70efabb5dcfa2d717f12a5d0c60ce15706f4663498016]
23:48:37.976 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:37.976 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:37.977 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0472db9478e0ae13a1f70efabb5dcfa2d717f12a5d0c60ce15706f4663498016 finished by subtask 0; deferring removal (restored in pending)
23:48:37.978 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:37.980 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:37.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:37.992 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.993 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:37.995 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:37.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:37.996 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:37.996 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:37.998 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:37.998 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.001 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:38.003 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf84f263f, L:/127.0.0.1:38052 - R:/127.8.22.193:34899] using TOKEN/null
23:48:38.007 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.008 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.019 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.019 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.060 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:38.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:38.060 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.060 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:38.064 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:38.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:38.065 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.065 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:38.076 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.077 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.091 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.091 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.114 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.114 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.119 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.119 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.123 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.123 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.128 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.128 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.184 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.184 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.188 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.189 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.197 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.197 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.202 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.202 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.209 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.209 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.214 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.214 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:38.255 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 86e770137b663b638a7b0ce49d5c917b (4928 bytes, checkpointDuration=385 ms, finalizationTime=1 ms).
23:48:38.259 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:48:38.259 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split e940cff2ef578f9685e1d0c8e9c7656e7e6479d881d483f9f1bdbbdc9f98281b from pending
23:48:38.259 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split a977b933d3a915a4c35e72dced75cab9bb2d8bf3762d69ba79fe5cd7ce3cef25 from pending
23:48:38.259 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 6185841dd57c2ef7f71e0752c798465208c57c880df5820fde6f0b678342f852 from pending
23:48:38.259 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 0472db9478e0ae13a1f70efabb5dcfa2d717f12a5d0c60ce15706f4663498016 from pending
23:48:38.259 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split e0a19fcb59fb6c5dbdd8ed96d5a77e3bbddc74f19d91ac451a087440dd2db689 from pending
23:48:38.259 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 43fc80f433a3e9d47fb499aff2f2164138bc87e68eb187680022ce326fe38e7c from pending
23:48:38.259 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 6 finished splits from enumerator state
23:48:38.272 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.272 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.277 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.277 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.283 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.283 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.290 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.290 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.294 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.294 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.299 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.299 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.356 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.356 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.364 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.364 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468118370 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:38.372 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.372 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.376 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=505, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@bd22015, flushNotification=Deferred@688985231(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:38.376 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] connecting to peer
23:48:38.378 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.378 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.385 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.386 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.390 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] Successfully connected to peer
23:48:38.391 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.391 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468118402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:38.405 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:38.409 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x7cf285bb, L:/127.0.0.1:38054 - R:/127.8.22.193:34899] using TOKEN/null
23:48:38.413 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:38.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
23:48:38.449 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:48:38.451 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
23:48:38.451 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=80 ms, finalizationTime=1 ms).
23:48:38.451 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
23:48:38.452 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
23:48:38.452 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id be7a18e0c9338df241a38b6571839023
23:48:38.453 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot be7a18e0c9338df241a38b6571839023.
23:48:38.454 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id be7a18e0c9338df241a38b6571839023.
23:48:38.455 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:48:38.450 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.455 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.455 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:48:38.459 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:38.461 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.461 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.466 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.466 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.467 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state RESTARTING to RUNNING.
23:48:38.468 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:48:38.468 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
23:48:38.469 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:48:38.469 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
23:48:38.470 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:38.471 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
23:48:38.471 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id dc06bb8446b4d03ecd66cf0d840502e8
23:48:38.473 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:38.474 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:38.474 [DEBUG - pool-76-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:38.475 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:38.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:38.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:38.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:38.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:38.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:38.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:38.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:38.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:38.476 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:38.477 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.477 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=27789, elapsed=27723), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [43ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [502ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [504ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1264ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2680ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2683ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6001ms] refreshing cache from master, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [6003ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [6004ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [6005ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6005ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [8440ms] refreshing cache from master, [8440ms] too many traces: truncated at 100 traces, deferred=Deferred@1956855500(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484)))
23:48:38.477 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.479 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=adcf4679f475414d88d97e4f0da4cdfd, attempt=12, KuduRpc(method=Scan, tablet=adcf4679f475414d88d97e4f0da4cdfd, attempt=12, TimeoutTracker(timeout=30000, elapsed=29936), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [278ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511], [278ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0xf2f432eb, L:/127.0.0.1:35500 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [476ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: connection closed, [476ms] delaying RPC due to: Network error: connection closed, [481ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [677ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: connection closed, [677ms] delaying RPC due to: Network error: connection closed, [680ms] refreshing cache from master, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [728ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [747ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [752ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [757ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [800ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [800ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [840ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [843ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [843ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [860ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [862ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [862ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [900ms] refreshing cache from master, [900ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [902ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [904ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [905ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [906ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [960ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [962ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [962ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [1160ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [1162ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [1162ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [2200ms] refreshing cache from master, [2200ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [2202ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2202ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2220ms] Sub RPC GetTableLocations: refreshing cache from master, [2220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2223ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2223ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2240ms] Sub RPC GetTableLocations: refreshing cache from master, [2240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2243ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2260ms] Sub RPC GetTableLocations: refreshing cache from master, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2265ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2265ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2280ms] Sub RPC GetTableLocations: refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2282ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2319ms] Sub RPC GetTableLocations: refreshing cache from master, [2320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2321ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2321ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2322ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2379ms] Sub RPC GetTableLocations: refreshing cache from master, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2382ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2440ms] Sub RPC GetTableLocations: refreshing cache from master, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2443ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2700ms] Sub RPC GetTableLocations: refreshing cache from master, [2700ms] too many traces: truncated at 100 traces, deferred=Deferred@1974416154(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0 -> (continuation of Deferred@2105117752 after retry RPC@1821185052) -> (continuation of Deferred@1043060984 after retry RPC@1959387746), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0 -> (continuation of Deferred@2105117752 after retry RPC@1821185052) -> (continuation of Deferred@1043060984 after retry RPC@1959387746)))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=27789, elapsed=27723), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [43ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [502ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [504ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1264ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2680ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2683ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6001ms] refreshing cache from master, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [6003ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [6004ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [6005ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6005ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [8440ms] refreshing cache from master, [8440ms] too many traces: truncated at 100 traces, deferred=Deferred@1956855500(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.479 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=27789, elapsed=27723), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [43ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [502ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [504ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1264ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2680ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2683ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6001ms] refreshing cache from master, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [6003ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [6004ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [6005ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6005ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [8440ms] refreshing cache from master, [8440ms] too many traces: truncated at 100 traces, deferred=Deferred@1956855500(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.480 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
23:48:38.480 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=27789, elapsed=27723), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [43ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [502ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [504ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1264ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2680ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2683ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6001ms] refreshing cache from master, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [6003ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [6004ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [6005ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6005ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [8440ms] refreshing cache from master, [8440ms] too many traces: truncated at 100 traces, deferred=Deferred@1956855500(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] disconnecting while in state TERMINATED
23:48:38.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.3.230.254:44025(127.3.230.254:44025)] disconnecting while in state TERMINATED
23:48:38.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.3.230.252:37691(127.3.230.252:37691)] disconnecting while in state TERMINATED
23:48:38.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state TERMINATED
23:48:38.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.3.230.253:41003(127.3.230.253:41003)] disconnecting while in state TERMINATED
23:48:38.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] disconnecting while in state TERMINATED
23:48:38.481 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.482 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.482 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.4.149.252:44265(127.4.149.252:44265)] disconnecting while in state TERMINATED
23:48:38.483 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.4.149.253:38083(127.4.149.253:38083)] disconnecting while in state TERMINATED
23:48:38.483 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] disconnecting while in state TERMINATED
23:48:38.483 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.4.149.254:41393(127.4.149.254:41393)] disconnecting while in state TERMINATED
23:48:38.483 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:38.483 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:38.484 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.484 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:48:38.484 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
23:48:38.484 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 7 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.485 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 7 thread-local buffer(s) from thread: kudu-nio-2
23:48:38.485 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 7 thread-local buffer(s) from thread: kudu-nio-4
23:48:38.485 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-5
23:48:38.485 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot dc06bb8446b4d03ecd66cf0d840502e8.
23:48:38.486 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
23:48:38.486 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 8 thread-local buffer(s) from thread: kudu-nio-1
23:48:38.486 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:48:38.487 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id dc06bb8446b4d03ecd66cf0d840502e8.
23:48:38.487 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.487 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.488 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
23:48:38.488 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
23:48:38.489 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37783bde
23:48:38.489 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:38.489 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:38.489 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:48:38.489 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:48:38.490 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:38.495 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:38.496 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@10355a1e
23:48:38.498 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:38.498 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:38.500 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:38.500 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:38.500 [WARN - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=27789, elapsed=27723), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [43ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [502ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [504ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1264ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2680ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2683ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6001ms] refreshing cache from master, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [6003ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [6004ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [6005ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6005ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [8440ms] refreshing cache from master, [8440ms] too many traces: truncated at 100 traces, deferred=Deferred@1956855500(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:48:38.504 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:38.508 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:38.508 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:38.508 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:38.508 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:38.508 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:38.508 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:38.509 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:38.517 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
23:48:38.518 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 661b3ac37579429493abf420457e9e8a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:38.518 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4cc02dfd5e5f4f678682f0beeac3a290 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:38.518 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 055500fad9db4cffb040b3818af066b3 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:38.518 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:38.519 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:38.519 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:38.520 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:38.522 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=661b3ac37579429493abf420457e9e8a@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=4cc02dfd5e5f4f678682f0beeac3a290@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=055500fad9db4cffb040b3818af066b3@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299997}]
23:48:38.526 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:38.527 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=27789, elapsed=27723), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [23ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [43ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [119ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [502ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [503ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [504ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1264ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2680ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2683ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2683ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6001ms] refreshing cache from master, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [6002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [6003ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [6004ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [6005ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6005ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [8440ms] refreshing cache from master, [8440ms] too many traces: truncated at 100 traces, deferred=Deferred@1956855500(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@888213174 after retry RPC after error@1292688162) -> (continuation of Deferred@1733936164 after retry RPC after error@174183261) -> (continuation of Deferred@920254489 after retry RPC after error@497545259) -> (continuation of Deferred@888565599 after retry RPC after error@814328231) -> (continuation of Deferred@1240045215 after retry RPC after error@1810694433) -> (continuation of Deferred@1827014548 after retry RPC after error@299851582) -> (continuation of Deferred@336035572 after retry RPC after error@392204636) -> (continuation of Deferred@1273429635 after retry RPC after error@548105838) -> (continuation of Deferred@259282001 after retry RPC after error@470670994) -> (continuation of Deferred@1625500022 after retry RPC after error@465629978) -> (continuation of Deferred@909900527 after retry RPC after error@1152404468) -> (continuation of Deferred@1038185101 after retry RPC after error@564469256) -> (continuation of Deferred@1218470993 after retry RPC after error@243886426) -> (continuation of Deferred@944379676 after retry RPC after error@831920963) -> (continuation of Deferred@2053071820 after retry RPC after error@1062798948) -> (continuation of Deferred@1472398436 after retry RPC after error@1452163548) -> (continuation of Deferred@1473120706 after retry RPC after error@542330745) -> (continuation of Deferred@1878826803 after retry RPC after error@1264100273) -> (continuation of Deferred@1828659969 after retry RPC after error@1458409824) -> (continuation of Deferred@1575192969 after retry RPC after error@1403583663) -> (continuation of Deferred@1180314352 after retry RPC after error@2089207242) -> (continuation of Deferred@1038656530 after retry RPC after error@691108484)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.253:41003
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.528 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
23:48:38.528 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
23:48:38.529 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state RUNNING to RESTARTING.
23:48:38.532 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6a58dc6d31435d98989ef54369be6d
23:48:38.534 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:38.535 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:38.535 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:38.535 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:38.535 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:38.535 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:38.535 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:38.536 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:38.536 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.7.104.126:33577, [3ms] Sub RPC GetTableLocations: received response from server master-127.7.104.126:33577: OK, deferred=null)) after lookup
23:48:38.540 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.253:41003(127.3.230.253:41003)] connecting to peer
23:48:38.541 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.254:44025(127.3.230.254:44025)] connecting to peer
23:48:38.541 [DEBUG - pool-80-thread-1] (Connection.java:748) [peer master-127.3.230.252:37691(127.3.230.252:37691)] connecting to peer
23:48:38.541 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:38.541 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.230.253:41003(127.3.230.253:41003)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:38.541 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.253:41003: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003
23:48:38.542 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:38.542 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.230.254:44025(127.3.230.254:44025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:38.542 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.254:44025: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025
23:48:38.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:38.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.230.252:37691(127.3.230.252:37691)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:38.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.230.252:37691: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
23:48:38.543 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691; will retry
23:48:38.544 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28211, elapsed=28204), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [21ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [41ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [62ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [679ms] refreshing cache from master, [679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [682ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1239ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1925ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5060ms] refreshing cache from master, [5060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [5062ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [5063ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6340ms] refreshing cache from master, [6340ms] too many traces: truncated at 100 traces, deferred=Deferred@767125344(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358)))
23:48:38.545 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, attempt=12, KuduRpc(method=Scan, tablet=2abbce68bf9b4cc0b8028cafc59c9d59, attempt=12, TimeoutTracker(timeout=30000, elapsed=29994), Traces: [0ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [275ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511], [275ms] delaying RPC due to: Network error: [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] unexpected exception from downstream on [id: 0x328bcef8, L:/127.0.0.1:35522 - R:/127.3.230.193:42511], [280ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [470ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625], [470ms] delaying RPC due to: Network error: [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] unexpected exception from downstream on [id: 0x2a85c82e, L:/127.0.0.1:49038 - R:/127.3.230.194:45625], [481ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [672ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473], [673ms] delaying RPC due to: Network error: [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] unexpected exception from downstream on [id: 0xb83fab45, L:/127.0.0.1:48884 - R:/127.3.230.195:35473], [700ms] refreshing cache from master, [700ms] Sub RPC GetTableLocations: refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [729ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [730ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [807ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: OK, [808ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [810ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [811ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [822ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [822ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [860ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [865ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [865ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [881ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [882ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [882ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [940ms] refreshing cache from master, [941ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [943ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: OK, [945ms] sending RPC to server 9c56332fbfac479b9424d32d20cd3a19, [946ms] received response from server 9c56332fbfac479b9424d32d20cd3a19: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [946ms] delaying RPC due to: Network error: Failed to connect to peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511): Connection refused: /127.3.230.193:42511, [1160ms] sending RPC to server 9460cad6b24b4916b63842f2742139a2, [1162ms] received response from server 9460cad6b24b4916b63842f2742139a2: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [1162ms] delaying RPC due to: Network error: Failed to connect to peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625): Connection refused: /127.3.230.194:45625, [1201ms] sending RPC to server 8d19df80ee04424f9dfce1f351ce4189, [1203ms] received response from server 8d19df80ee04424f9dfce1f351ce4189: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [1203ms] delaying RPC due to: Network error: Failed to connect to peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473): Connection refused: /127.3.230.195:35473, [1781ms] refreshing cache from master, [1781ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.230.252:37691, [1783ms] Sub RPC GetTableLocations: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1783ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1800ms] Sub RPC GetTableLocations: refreshing cache from master, [1800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1802ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1820ms] Sub RPC GetTableLocations: refreshing cache from master, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1822ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1841ms] Sub RPC GetTableLocations: refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1843ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1860ms] Sub RPC GetTableLocations: refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1863ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1901ms] Sub RPC GetTableLocations: refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1904ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1904ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1940ms] Sub RPC GetTableLocations: refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1944ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2021ms] Sub RPC GetTableLocations: refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [2023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [2023ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [2024ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2024ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2081ms] Sub RPC GetTableLocations: refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [2082ms] too many traces: truncated at 100 traces, deferred=Deferred@2075948387(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0 -> (continuation of Deferred@2075976504 after retry RPC@1705043109) -> (continuation of Deferred@1201977282 after retry RPC@1439254193), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0 -> (continuation of Deferred@2075976504 after retry RPC@1705043109) -> (continuation of Deferred@1201977282 after retry RPC@1439254193)))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28211, elapsed=28204), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [21ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [41ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [62ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [679ms] refreshing cache from master, [679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [682ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1239ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1925ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5060ms] refreshing cache from master, [5060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [5062ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [5063ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6340ms] refreshing cache from master, [6340ms] too many traces: truncated at 100 traces, deferred=Deferred@767125344(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.546 [DEBUG - pool-44-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30021), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: OK, deferred=null) with no deferred attached!
23:48:38.547 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28211, elapsed=28204), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [21ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [41ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [62ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [679ms] refreshing cache from master, [679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [682ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1239ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1925ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5060ms] refreshing cache from master, [5060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [5062ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [5063ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6340ms] refreshing cache from master, [6340ms] too many traces: truncated at 100 traces, deferred=Deferred@767125344(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.548 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
23:48:38.548 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28211, elapsed=28204), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [21ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [41ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [62ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [679ms] refreshing cache from master, [679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [682ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1239ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1925ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5060ms] refreshing cache from master, [5060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [5062ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [5063ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6340ms] refreshing cache from master, [6340ms] too many traces: truncated at 100 traces, deferred=Deferred@767125344(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 8d19df80ee04424f9dfce1f351ce4189(127.3.230.195:35473)] disconnecting while in state TERMINATED
23:48:38.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.3.230.254:44025(127.3.230.254:44025)] disconnecting while in state TERMINATED
23:48:38.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.3.230.252:37691(127.3.230.252:37691)] disconnecting while in state TERMINATED
23:48:38.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9c56332fbfac479b9424d32d20cd3a19(127.3.230.193:42511)] disconnecting while in state TERMINATED
23:48:38.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.3.230.253:41003(127.3.230.253:41003)] disconnecting while in state TERMINATED
23:48:38.550 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9460cad6b24b4916b63842f2742139a2(127.3.230.194:45625)] disconnecting while in state TERMINATED
23:48:38.551 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.4.149.252:44265(127.4.149.252:44265)] disconnecting while in state TERMINATED
23:48:38.551 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.4.149.253:38083(127.4.149.253:38083)] disconnecting while in state TERMINATED
23:48:38.551 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ce4de942beb74ff39c48ff0e7609df79(127.4.149.193:36799)] disconnecting while in state TERMINATED
23:48:38.551 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.4.149.254:41393(127.4.149.254:41393)] disconnecting while in state TERMINATED
23:48:38.552 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:38.552 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
23:48:38.553 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:38.553 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.553 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:38.553 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 8 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.554 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-1
23:48:38.554 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-2
23:48:38.554 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
23:48:38.555 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
23:48:38.555 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:48:38.555 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-4
23:48:38.556 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
23:48:38.556 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
23:48:38.557 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@40a78a8f
23:48:38.557 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:38.557 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:38.558 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:48:38.558 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:48:38.567 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3866a0f8
23:48:38.567 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.568 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.568 [DEBUG - main] (Connection.java:748) [peer 1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)] connecting to peer
23:48:38.582 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.592 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:38.606 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:48:38.607 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:38.607 [WARN - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28211, elapsed=28204), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [21ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [41ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [62ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [679ms] refreshing cache from master, [679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [682ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1239ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1925ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5060ms] refreshing cache from master, [5060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [5062ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [5063ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6340ms] refreshing cache from master, [6340ms] too many traces: truncated at 100 traces, deferred=Deferred@767125344(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.608 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:48:38.613 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
23:48:38.618 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=28211, elapsed=28204), Traces: [0ms] sending RPC to server master-127.3.230.252:37691, [2ms] received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [21ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [41ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [61ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [62ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [62ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [679ms] refreshing cache from master, [679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [682ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [682ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1239ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [1925ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5060ms] refreshing cache from master, [5060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.253:41003, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.254:44025, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.230.252:37691, [5062ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.253:41003: Network error: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.254:44025: Network error: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025, [5063ms] Sub RPC ConnectToMaster: received response from server master-127.3.230.252:37691: Network error: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [5063ms] delaying RPC due to: Service unavailable: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691, [6340ms] refreshing cache from master, [6340ms] too many traces: truncated at 100 traces, deferred=Deferred@767125344(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1097346209 after retry RPC after error@1354225163) -> (continuation of Deferred@1995023758 after retry RPC after error@269307476) -> (continuation of Deferred@268461520 after retry RPC after error@2120871509) -> (continuation of Deferred@1167585731 after retry RPC after error@1066559691) -> (continuation of Deferred@749708300 after retry RPC after error@495320202) -> (continuation of Deferred@1734741776 after retry RPC after error@1260320519) -> (continuation of Deferred@448837036 after retry RPC after error@680754130) -> (continuation of Deferred@2136665951 after retry RPC after error@1128307068) -> (continuation of Deferred@1546791277 after retry RPC after error@1875674322) -> (continuation of Deferred@1204072035 after retry RPC after error@541854) -> (continuation of Deferred@1304194227 after retry RPC after error@1188928450) -> (continuation of Deferred@612926156 after retry RPC after error@1717968503) -> (continuation of Deferred@1209085948 after retry RPC after error@1647881911) -> (continuation of Deferred@46587614 after retry RPC after error@1418063191) -> (continuation of Deferred@355096308 after retry RPC after error@851447792) -> (continuation of Deferred@113510232 after retry RPC after error@2110827906) -> (continuation of Deferred@973785402 after retry RPC after error@134741508) -> (continuation of Deferred@778032795 after retry RPC after error@1444663919) -> (continuation of Deferred@976523919 after retry RPC after error@225750035) -> (continuation of Deferred@1565476904 after retry RPC after error@1439658308) -> (continuation of Deferred@1265705368 after retry RPC after error@1674385617) -> (continuation of Deferred@1147409032 after retry RPC after error@1787764241) -> (continuation of Deferred@682659641 after retry RPC after error@598741358)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.230.253:41003,127.3.230.254:44025,127.3.230.252:37691) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.253:41003(127.3.230.253:41003): Connection refused: /127.3.230.253:41003,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.254:44025(127.3.230.254:44025): Connection refused: /127.3.230.254:44025,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.230.252:37691(127.3.230.252:37691): Connection refused: /127.3.230.252:37691
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.230.252:37691
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:38.619 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:48:38.619 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
23:48:38.619 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
23:48:38.623 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)] Successfully connected to peer
23:48:38.624 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.629 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.629 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.629 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.635 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.636 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.637 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.637 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.637 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.638 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.638 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.638 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.639 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.640 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.640 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.640 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.642 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.642 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.651 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.651 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.653 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.653 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.653 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.653 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.655 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.656 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.658 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.658 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.658 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.658 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.658 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:38.662 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.663 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x658c10b6, L:/127.0.0.1:55950 - R:/127.7.104.65:45995] using TOKEN/null
23:48:38.667 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.678 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.680 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.680 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.683 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.683 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.684 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.684 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.684 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.685 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.685 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.682 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.686 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.687 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.692 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.692 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f4f3a8a917ec4959bafa5da9932eb932, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.692 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet f4f3a8a917ec4959bafa5da9932eb932 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.696 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.697 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0dd39db2759a4265b52a1bcd82c9b355, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.698 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0dd39db2759a4265b52a1bcd82c9b355 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.703 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.704 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.704 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.704 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.704 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.704 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.705 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.705 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.705 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.705 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.707 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.708 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.708 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.708 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.714 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4238b4248ecd495d9d7fe29bf37abc0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.715 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4238b4248ecd495d9d7fe29bf37abc0b for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.715 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.717 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.720 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0a7473c87ce1473fab3709d68c863dcd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.721 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 0a7473c87ce1473fab3709d68c863dcd for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.725 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.725 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.725 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.726 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.726 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.726 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.726 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.726 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.726 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.727 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50339fc54f264099966359f5cbc63947, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.727 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50339fc54f264099966359f5cbc63947 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 661b3ac37579429493abf420457e9e8a for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:38.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4cc02dfd5e5f4f678682f0beeac3a290 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:38.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 055500fad9db4cffb040b3818af066b3 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:38.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet b4d3a334030d4353921fc9bde4b759f4 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:38.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet fb7c93703cbb4db6be37110dbd6d4d0b for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:38.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ff0ff57d18644a9285d2c0bca1167e06 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:38.731 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=661b3ac37579429493abf420457e9e8a@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=4cc02dfd5e5f4f678682f0beeac3a290@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=055500fad9db4cffb040b3818af066b3@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=b4d3a334030d4353921fc9bde4b759f4@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fb7c93703cbb4db6be37110dbd6d4d0b@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843),1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=ff0ff57d18644a9285d2c0bca1167e06@[183b79dc80df4a9583cef13752304681(127.8.22.194:33843)[L],1fff25c44dbc403aa121b78bede605f8(127.8.22.195:42601),2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:38.732 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.8.22.252:44235, [2ms] Sub RPC GetTableLocations: received response from server master-127.8.22.252:44235: OK, deferred=null)) after lookup
23:48:38.738 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.739 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.739 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.739 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.739 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.739 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.740 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.740 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.740 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.740 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.740 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.741 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.741 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.741 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.741 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.745 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:38.751 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.752 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.756 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.756 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.756 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.756 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.756 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.757 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.757 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.757 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.757 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.757 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.757 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.757 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.757 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.759 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.760 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.762 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.763 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.763 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.764 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.765 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.765 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.765 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.765 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.765 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.767 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.767 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.771 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.772 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.775 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:38.776 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:38.776 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:38.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:38.776 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:38.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:38.777 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:38.778 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:38.778 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:38.778 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:38.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:38.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:38.778 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:38.783 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.783 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.783 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.784 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.784 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.784 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.785 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.785 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.785 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.785 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.785 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.785 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.786 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.792 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f4f3a8a917ec4959bafa5da9932eb932, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.793 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet f4f3a8a917ec4959bafa5da9932eb932 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.796 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.796 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.797 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.797 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.797 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.797 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.798 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.798 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.798 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.798 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.799 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.799 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0dd39db2759a4265b52a1bcd82c9b355, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0dd39db2759a4265b52a1bcd82c9b355 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.817 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4238b4248ecd495d9d7fe29bf37abc0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.818 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4238b4248ecd495d9d7fe29bf37abc0b for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.825 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0a7473c87ce1473fab3709d68c863dcd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.825 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 0a7473c87ce1473fab3709d68c863dcd for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.831 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50339fc54f264099966359f5cbc63947, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.831 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50339fc54f264099966359f5cbc63947 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.843 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.844 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.844 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.845 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.845 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.845 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.846 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.846 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.846 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.846 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.856 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.856 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.857 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.857 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.858 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=661b3ac37579429493abf420457e9e8a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 661b3ac37579429493abf420457e9e8a for partition [0x00000000, 0x0000000080000032) with scanner id null
23:48:38.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468118869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:38.870 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4cc02dfd5e5f4f678682f0beeac3a290, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.871 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4cc02dfd5e5f4f678682f0beeac3a290 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
23:48:38.875 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=055500fad9db4cffb040b3818af066b3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.875 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 055500fad9db4cffb040b3818af066b3 for partition [0x0000000080000096, 0x00000001) with scanner id null
23:48:38.884 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b4d3a334030d4353921fc9bde4b759f4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.884 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b4d3a334030d4353921fc9bde4b759f4 for partition [0x00000001, 0x0000000180000032) with scanner id null
23:48:38.885 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:38.916 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fb7c93703cbb4db6be37110dbd6d4d0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.916 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fb7c93703cbb4db6be37110dbd6d4d0b for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
23:48:38.918 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:48:38.924 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468118915 for job 6b15b774f375318429e8c166741c1d9d.
23:48:38.944 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=28 ms, finalizationTime=1 ms).
23:48:38.946 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
23:48:38.971 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ff0ff57d18644a9285d2c0bca1167e06, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:38.971 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet ff0ff57d18644a9285d2c0bca1167e06 for partition [0x0000000180000096, 0x00000002) with scanner id null
23:48:38.972 [DEBUG - main] (Connection.java:575) [peer master-127.8.22.253:33181(127.8.22.253:33181)] disconnecting while in state READY
23:48:38.972 [DEBUG - main] (Connection.java:575) [peer master-127.8.22.254:45201(127.8.22.254:45201)] disconnecting while in state READY
23:48:38.972 [DEBUG - main] (Connection.java:575) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] disconnecting while in state READY
23:48:38.972 [DEBUG - main] (Connection.java:575) [peer 183b79dc80df4a9583cef13752304681(127.8.22.194:33843)] disconnecting while in state READY
23:48:38.972 [DEBUG - main] (Connection.java:575) [peer master-127.8.22.252:44235(127.8.22.252:44235)] disconnecting while in state READY
23:48:38.973 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.8.22.253:33181(127.8.22.253:33181)] handling channelInactive
23:48:38.973 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.8.22.254:45201(127.8.22.254:45201)] handling channelInactive
23:48:38.973 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state READY due to: connection closed
23:48:38.973 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state READY due to: connection closed
23:48:38.974 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] handling channelInactive
23:48:38.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] cleaning up while in state READY due to: connection closed
23:48:38.974 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.8.22.252:44235(127.8.22.252:44235)] handling channelInactive
23:48:38.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state READY due to: connection closed
23:48:38.976 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:38.979 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:38.980 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:38.980 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:38.980 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.980 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.981 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:38.981 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.981 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.981 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:38.982 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:48:38.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:38.982 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:38.982 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
23:48:38.982 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
23:48:38.984 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:48:38.988 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 183b79dc80df4a9583cef13752304681(127.8.22.194:33843)] handling channelInactive
23:48:38.988 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 183b79dc80df4a9583cef13752304681(127.8.22.194:33843)] cleaning up while in state READY due to: connection closed
23:48:38.989 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
23:48:38.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:38.990878  8283 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8566
23:48:39.043 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.043 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.043 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.045 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.083 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.083 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.084 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.085 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.085 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.085 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.086 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.086 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.086 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.086 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:39.097110  8688 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:39.183 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.183 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.183 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.185 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.185 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.185 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.185 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.186 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.186 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.186 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.203 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:39.207 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:39.207 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:39.207 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:39.207 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:39.207 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:39.207 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:39.207 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:39.212 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='11ec677c55f83dd6732545f57f5c0fef6967a2b725e02ae64cffc65ae37d0b5f'}]
23:48:39.212 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='246a59c3db7ff8fee6e19c71498799de3495bb90c6cb798bdd86d38a62a8f676'}]
23:48:39.213 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='14fad989f28ef1f3e296c9742b463a37b821464c6f51b429d8e6cd35a1a73229'}]
23:48:39.214 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.214 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:39.215 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.215 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:39.215 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b2503ab06e7e42b51aefc4e3492fbf9c2c1090e3fe0185973975a6f6d2f57de9'}]
23:48:39.216 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.216 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:39.217 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.217 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:39.217 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}]
23:48:39.217 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:39.218 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:39.218 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}]
23:48:39.229 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:39.236 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:39.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:39.256 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.257 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.257 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.257 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.257 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.258 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.258 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.258 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.258 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.259 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.261 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:39.273 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:39.275 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.276 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.276 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.277 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.277 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.277 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.277 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.277 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.278 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.278 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.278 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.278 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.278 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.294 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:39.315 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:39.316 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:39.336 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:39.339 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:39.347 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:39.373 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468119369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:39.382 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:39.382 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:39.385 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 86e770137b663b638a7b0ce49d5c917b (4988 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:39.388 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:48:39.400 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:39.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468119402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:39.416 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:48:39.417 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
23:48:39.421 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:39.439 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:39.445 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x30681c85, L:/127.0.0.1:57656 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:39.447 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x55c129f0, L:/127.0.0.1:57652 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:39.456 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:39.479 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085416243200001) for scanner KuduScanner(table=replication_test_table, tablet=4238b4248ecd495d9d7fe29bf37abc0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:39.480 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [11ec677c55f83dd6732545f57f5c0fef6967a2b725e02ae64cffc65ae37d0b5f]
23:48:39.480 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [11ec677c55f83dd6732545f57f5c0fef6967a2b725e02ae64cffc65ae37d0b5f]
23:48:39.481 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:48:39.481 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:48:39.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:39.482 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:39.482 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 11ec677c55f83dd6732545f57f5c0fef6967a2b725e02ae64cffc65ae37d0b5f finished by subtask 0; deferring removal (restored in pending)
23:48:39.483 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe4177525, L:/127.0.0.1:57670 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:39.484 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='14c7b6dc2ac87ba471e09a7996b521c5f99c45d66db1e156177c9c67b5ad451a'}]
23:48:39.486 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.487 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:48:39.487 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085416243200001) for scanner KuduScanner(table=replication_test_table, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:39.487 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [246a59c3db7ff8fee6e19c71498799de3495bb90c6cb798bdd86d38a62a8f676]
23:48:39.487 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [246a59c3db7ff8fee6e19c71498799de3495bb90c6cb798bdd86d38a62a8f676]
23:48:39.488 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:39.488 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:39.488 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:39.488 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:39.489 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 246a59c3db7ff8fee6e19c71498799de3495bb90c6cb798bdd86d38a62a8f676 finished by subtask 2; deferring removal (restored in pending)
23:48:39.490 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='38fc584eac8bc9fd4939a5e205f0f88ffe922fb91596d6d348f7d15f6da97524'}]
23:48:39.492 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.495 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:39.496 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x73a8ca23, L:/127.0.0.1:57680 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:39.515 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085416243200001) for scanner KuduScanner(table=replication_test_table, tablet=f4f3a8a917ec4959bafa5da9932eb932, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:39.516 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [14fad989f28ef1f3e296c9742b463a37b821464c6f51b429d8e6cd35a1a73229]
23:48:39.516 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [14fad989f28ef1f3e296c9742b463a37b821464c6f51b429d8e6cd35a1a73229]
23:48:39.517 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:39.517 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:39.517 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:39.518 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 14fad989f28ef1f3e296c9742b463a37b821464c6f51b429d8e6cd35a1a73229 finished by subtask 3; deferring removal (restored in pending)
23:48:39.518 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:39.520 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:39.576 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:39.576 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085416243200001) for scanner KuduScanner(table=replication_test_table, tablet=0dd39db2759a4265b52a1bcd82c9b355, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:39.577 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299996, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:39.577 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [b2503ab06e7e42b51aefc4e3492fbf9c2c1090e3fe0185973975a6f6d2f57de9]
23:48:39.577 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b2503ab06e7e42b51aefc4e3492fbf9c2c1090e3fe0185973975a6f6d2f57de9]
23:48:39.578 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:48:39.578 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:48:39.578 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:39.579 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:39.580 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b2503ab06e7e42b51aefc4e3492fbf9c2c1090e3fe0185973975a6f6d2f57de9 finished by subtask 1; deferring removal (restored in pending)
23:48:39.582 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:39.582 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:39.583 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:39.583 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:39.588 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:39.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:39.589 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:39.589 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:39.589 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:39.603 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:39.607 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:39.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:39.607 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:39.607 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:39.610 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:39.624 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:39.629 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb7693592, L:/127.0.0.1:60238 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:39.637 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:39.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:39.638 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:39.638 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:39.647 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085416243200001) for scanner KuduScanner(table=replication_test_table, tablet=50339fc54f264099966359f5cbc63947, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:39.647 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [38fc584eac8bc9fd4939a5e205f0f88ffe922fb91596d6d348f7d15f6da97524]
23:48:39.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [38fc584eac8bc9fd4939a5e205f0f88ffe922fb91596d6d348f7d15f6da97524]
23:48:39.648 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:48:39.648 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:48:39.649 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 38fc584eac8bc9fd4939a5e205f0f88ffe922fb91596d6d348f7d15f6da97524 finished by subtask 2; deferring removal (restored in pending)
23:48:39.649 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:39.655 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:39.661 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:39.676 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:39.693 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:39.696 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.696 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.696 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.698 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.698 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.698 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.699 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.703 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:39.703 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:39.703 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:39.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:39.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:39.704 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:39.704 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:39.704 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:39.704 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:39.705 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:39.705 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:39.705 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:39.705 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:39.713 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x84f30d72, L:/127.0.0.1:60246 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:39.715 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:39.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:39.716 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:39.720 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:39.722 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085416243200001) for scanner KuduScanner(table=replication_test_table, tablet=0a7473c87ce1473fab3709d68c863dcd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:39.722 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [14c7b6dc2ac87ba471e09a7996b521c5f99c45d66db1e156177c9c67b5ad451a]
23:48:39.722 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [14c7b6dc2ac87ba471e09a7996b521c5f99c45d66db1e156177c9c67b5ad451a]
23:48:39.723 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
23:48:39.723 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
23:48:39.724 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 14c7b6dc2ac87ba471e09a7996b521c5f99c45d66db1e156177c9c67b5ad451a finished by subtask 0; deferring removal (restored in pending)
23:48:39.725 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:39.725 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:39.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:39.765 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:39.765 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:39.765 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:39.765 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:48:39.803 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.803 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.803 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.804 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.804 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.804 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.805 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.805 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.805 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.805 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.805 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.806 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.806 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468119869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:39.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:39.874341  8283 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8566
23:48:39.883 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 86e770137b663b638a7b0ce49d5c917b (4988 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:48:39.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:48:39.885 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split b2503ab06e7e42b51aefc4e3492fbf9c2c1090e3fe0185973975a6f6d2f57de9 from pending
23:48:39.885 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 38fc584eac8bc9fd4939a5e205f0f88ffe922fb91596d6d348f7d15f6da97524 from pending
23:48:39.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 11ec677c55f83dd6732545f57f5c0fef6967a2b725e02ae64cffc65ae37d0b5f from pending
23:48:39.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 14fad989f28ef1f3e296c9742b463a37b821464c6f51b429d8e6cd35a1a73229 from pending
23:48:39.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 246a59c3db7ff8fee6e19c71498799de3495bb90c6cb798bdd86d38a62a8f676 from pending
23:48:39.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 14c7b6dc2ac87ba471e09a7996b521c5f99c45d66db1e156177c9c67b5ad451a from pending
23:48:39.886 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 6 finished splits from enumerator state
23:48:39.891 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:48:39.892 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
23:48:39.893 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:48:39.893 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
23:48:39.894 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
23:48:39.894 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id 2750b63c4d5504ec57bd2f23b98fae74
23:48:39.894 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state RESTARTING to RUNNING.
23:48:39.896 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:39.894 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2750b63c4d5504ec57bd2f23b98fae74.
23:48:39.898 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 2750b63c4d5504ec57bd2f23b98fae74.
23:48:39.899 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:48:39.899 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
23:48:39.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:48:39.900 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
23:48:39.900 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:39.901 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
23:48:39.901 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id 9eb4051c1a4055e19a4fd12d5e8e0fbb
23:48:39.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468119903 for job 6b15b774f375318429e8c166741c1d9d.
23:48:39.906 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:48:39.908 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:48:39.908 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
23:48:39.908 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
23:48:39.912 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@514924d5
23:48:39.913 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:39.914 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:39.914 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
23:48:39.914 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
23:48:39.915 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5e5459ae
23:48:39.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
23:48:39.915 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:39.915 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:39.918 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:48:39.919 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:48:39.919 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:48:39.920 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:48:39.920 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:48:39.931 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d70e3d2
23:48:39.934 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.937 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@267fd71b
23:48:39.939 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:39.943 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.967 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:39.979 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.981 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:39.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.982 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.982 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:39.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:39.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.992 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.992 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:39.992 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:39.992 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:39.994 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.994 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:39.995 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] handling channelInactive
23:48:39.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] cleaning up while in state READY due to: connection closed
23:48:39.996 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] handling channelInactive
23:48:39.996 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] cleaning up while in state READY due to: connection closed
23:48:39.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:39.996670  8858 connection.cc:573] server connection from 127.8.22.193:60881 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:39.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:39.997254  8720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.22.193:34899 (error 108)
23:48:39.999 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.003 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.008 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.009145  8283 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8703
23:48:40.011 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.013 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.016 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.016 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.024 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.027 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.041 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:40.042438  8720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.22.193:34899, user_credentials={real_user=slave}} blocked reactor thread for 44714.6us
23:48:40.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.050 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.061 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.064 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.064 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.064 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.065 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.066 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:40.066210  8720 consensus_peers.cc:597] T ff0ff57d18644a9285d2c0bca1167e06 P 183b79dc80df4a9583cef13752304681 -> Peer 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899): Couldn't send request to peer 2100c738f2f94e4884d53e49614df1c4. Status: Network error: Client connection negotiation failed: client connection to 127.8.22.193:34899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:48:40.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.072682  8825 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:40.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.076745  9094 raft_consensus.cc:493] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2100c738f2f94e4884d53e49614df1c4)
23:48:40.083 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.084 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.084 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.084 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.084 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.084 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.085 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.085 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.085 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.085 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.085 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.085 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.085 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.085 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.085 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.087 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.100 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.103 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.104 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.104 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.104 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.104 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.104 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.105 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.105 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.105 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.105 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.105 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.105 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.106 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.106 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.106 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.106 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.127 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.129 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.129 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.129 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.130 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.130 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.130 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.130 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.130 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.130 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.144 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.145 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.145 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.146 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.146 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.147 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.148 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.148 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.148 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.149 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.149 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.149 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.149 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.149 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.149 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.149 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.149 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.149 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.188 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.189 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.189 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.189 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.190 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.190 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.190 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.204 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.204 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.205 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.206 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.206 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.206 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.206 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.206 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.207 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:40.248 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.248 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.248 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.249 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.249 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.250 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.250 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.250 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.250 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.250 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.282922  9435 raft_consensus.cc:493] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2100c738f2f94e4884d53e49614df1c4)
23:48:40.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.283391  9435 raft_consensus.cc:515] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:40.283 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.284 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.284 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.285 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.285559  9435 leader_election.cc:290] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899), 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843)
23:48:40.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:40.320367  8858 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.22.193:34899: connect: Connection refused (error 111)
23:48:40.324 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.324 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.324 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.325 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.325 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.325 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.326 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.326 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.326 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.326 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.326 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.326 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.326 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.328 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.329 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.329 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.330 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.330 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.330 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:40.337296  8858 leader_election.cc:336] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899): Network error: Client connection negotiation failed: client connection to 127.8.22.193:34899: connect: Connection refused (error 111)
23:48:40.368 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.368 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.368 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.369 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.369 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.369 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.370 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468120369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:40.370 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.370 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.370 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.370 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.385 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
23:48:40.386 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:48:40.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468120403 for job 6b15b774f375318429e8c166741c1d9d.
23:48:40.412 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:40.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.465554  9094 raft_consensus.cc:515] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } }
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.466455  9094 leader_election.cc:290] T fb7c93703cbb4db6be37110dbd6d4d0b P 183b79dc80df4a9583cef13752304681 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.466681  9094 raft_consensus.cc:493] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2100c738f2f94e4884d53e49614df1c4)
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.466988  9094 raft_consensus.cc:515] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2100c738f2f94e4884d53e49614df1c4" member_type: VOTER last_known_addr { host: "127.8.22.193" port: 34899 } } peers { permanent_uuid: "1fff25c44dbc403aa121b78bede605f8" member_type: VOTER last_known_addr { host: "127.8.22.195" port: 42601 } } peers { permanent_uuid: "183b79dc80df4a9583cef13752304681" member_type: VOTER last_known_addr { host: "127.8.22.194" port: 33843 } }
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.467590  9094 leader_election.cc:290] T 055500fad9db4cffb040b3818af066b3 P 183b79dc80df4a9583cef13752304681 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2100c738f2f94e4884d53e49614df1c4 (127.8.22.193:34899), 1fff25c44dbc403aa121b78bede605f8 (127.8.22.195:42601)
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.467777  8283 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8703
23:48:40.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.468104  9094 raft_consensus.cc:493] T 661b3ac37579429493abf420457e9e8a P 183b79dc80df4a9583cef13752304681 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2100c738f2f94e4884d53e49614df1c4)
23:48:40.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.506748  8283 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8837
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:40.507330  9436 negotiation.cc:336] Failed RPC negotiation. Trace:
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:48:40.306587 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.22.194:33843 (local address 127.8.22.195:41499)
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:48:40.309728 (+  3141us) negotiation.cc:107] Waiting for socket to connect
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:48:40.309747 (+    19us) client_negotiation.cc:175] Beginning negotiation
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:48:40.309918 (+   171us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:48:40.506104 (+196186us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.22.194:33843: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":3039,"thread_start_us":13257,"threads_started":1}
23:48:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:40.509954  8858 leader_election.cc:336] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 183b79dc80df4a9583cef13752304681 (127.8.22.194:33843): Network error: Client connection negotiation failed: client connection to 127.8.22.194:33843: connect: Connection refused (error 111)
23:48:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.510141  8858 leader_election.cc:304] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1fff25c44dbc403aa121b78bede605f8; no voters: 183b79dc80df4a9583cef13752304681, 2100c738f2f94e4884d53e49614df1c4
23:48:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.510985  9435 raft_consensus.cc:2749] T 4cc02dfd5e5f4f678682f0beeac3a290 P 1fff25c44dbc403aa121b78bede605f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
23:48:40.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.518481  8963 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:40.536 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.536 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.537 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.537 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.538 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.538 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.538 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.539 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.539 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.651940  8283 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8837
23:48:40.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.674059  8283 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8294
23:48:40.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.675544  8356 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:40.688 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.689 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.689 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.689 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.689 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.689 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.690 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.690 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.690 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.690 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.690 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:40.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.799546  8283 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8294
23:48:40.803 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.803 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.804 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.804 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.804 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.804 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.804 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.804 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.804 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.805 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.805 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.805 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.805 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.823 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.823 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.8.22.254:45201(127.8.22.254:45201)] handling channelInactive
23:48:40.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state READY due to: connection closed
23:48:40.823 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.823 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.8.22.254:45201(127.8.22.254:45201)] handling channelInactive
23:48:40.824 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state READY due to: connection closed
23:48:40.824 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.8.22.254:45201(127.8.22.254:45201)] handling channelInactive
23:48:40.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state READY due to: connection closed
23:48:40.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.825 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.825 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.825 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.825052  8283 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8363
23:48:40.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.825 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.825 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.826 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.8.22.254:45201(127.8.22.254:45201)] handling channelInactive
23:48:40.826 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state READY due to: connection closed
23:48:40.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.826203  8427 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:40.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468120869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:40.885 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
23:48:40.889 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:48:40.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468120902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:40.914 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:40.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
23:48:40.928 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:40.929 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:40.929 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:40.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:40.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:40.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:40.930 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:40.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.954367  8283 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8363
23:48:40.984 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.8.22.253:33181(127.8.22.253:33181)] handling channelInactive
23:48:40.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state READY due to: connection closed
23:48:40.985 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.8.22.253:33181(127.8.22.253:33181)] handling channelInactive
23:48:40.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state READY due to: connection closed
23:48:40.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:40.986 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.8.22.253:33181(127.8.22.253:33181)] handling channelInactive
23:48:40.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state READY due to: connection closed
23:48:40.984 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.8.22.253:33181(127.8.22.253:33181)] handling channelInactive
23:48:40.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.986366  8283 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8434
23:48:40.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state READY due to: connection closed
23:48:40.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:40.987857  8499 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:41.103 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:41.104 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:41.104 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:41.105 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:41.105 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:41.105 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:41.105 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:41.106 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:41.106 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:41.106 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:41.106 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:41.106 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:41.106 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:41.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:41.183398  8283 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8434
23:48:41.203 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 95fd4697a05144e59514710ebcacd16c
23:48:41.208 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6ce6ef6227b04bf7b893c2f8c4d4daa1 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
23:48:41.208 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f4f3a8a917ec4959bafa5da9932eb932 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
23:48:41.208 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0dd39db2759a4265b52a1bcd82c9b355 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
23:48:41.208 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4238b4248ecd495d9d7fe29bf37abc0b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
23:48:41.208 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0a7473c87ce1473fab3709d68c863dcd for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
23:48:41.209 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 50339fc54f264099966359f5cbc63947 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
23:48:41.209 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
23:48:41.213 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a1fe4345e978cfce0f06190e31c9adcc03f3bda122fd5179ccaa5220b293e926'}]
23:48:41.214 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.8.22.252:44235(127.8.22.252:44235)] handling channelInactive
23:48:41.214 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state READY due to: connection closed
23:48:41.215 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5eec844d392129e43004a8e1b65c1733efa702caf82cddc3b92fb9d381dae1ec'}]
23:48:41.215 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.8.22.252:44235(127.8.22.252:44235)] handling channelInactive
23:48:41.215 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.8.22.252:44235(127.8.22.252:44235)] handling channelInactive
23:48:41.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state READY due to: connection closed
23:48:41.216 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='63bfcd72721fa646634f0fa8109cb56174aef6f1e562602300c8f0fedf8407aa'}]
23:48:41.217 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a8064fec2dddf6829541a6521e99f0c5343075953df38ce45a4de7e52601d18b'}]
23:48:41.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state READY due to: connection closed
23:48:41.219 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.8.22.252:44235(127.8.22.252:44235)] handling channelInactive
23:48:41.219 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state READY due to: connection closed
23:48:41.223 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:41.223 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:48:41.224 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}]
23:48:41.226 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:41.226 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
23:48:41.227 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=4238b4248ecd495d9d7fe29bf37abc0b@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:41.228 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:41.229 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:41.230 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:48:41.230 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299998, tablet=0dd39db2759a4265b52a1bcd82c9b355@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)[L]]}]
23:48:41.231 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:48:41.231 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=f4f3a8a917ec4959bafa5da9932eb932@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:41.234 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:41.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:41Z chronyd exiting
23:48:41.236 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:41.238 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:41.239 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:41.240 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:41.242 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:41.243 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:41.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:41.254 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:41.258 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xea8ca896, L:/127.0.0.1:60248 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:41.260 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:41.263 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:41.265 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:41.269 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:41.276 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:41.279 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:41.283 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc6362517, L:/127.0.0.1:60256 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:41.302 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085424435200001) for scanner KuduScanner(table=replication_test_table, tablet=4238b4248ecd495d9d7fe29bf37abc0b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:41.303 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [a8064fec2dddf6829541a6521e99f0c5343075953df38ce45a4de7e52601d18b]
23:48:41.303 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a8064fec2dddf6829541a6521e99f0c5343075953df38ce45a4de7e52601d18b]
23:48:41.303 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
23:48:41.304 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
23:48:41.306 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a8064fec2dddf6829541a6521e99f0c5343075953df38ce45a4de7e52601d18b finished by subtask 0; deferring removal (restored in pending)
23:48:41.307 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.307 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b3e1e9510333ddd4e8a43368a03d639651d7e9881b415e032c9ef46450ffd643'}]
23:48:41.309 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:41.309 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
23:48:41.310 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=0a7473c87ce1473fab3709d68c863dcd@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995),aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)[L],e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:41.317 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:41.323 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:41.332 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1d30d9e1, L:/127.0.0.1:60270 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:41.343 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0fc83172, L:/127.0.0.1:60272 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:41.349 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
23:48:41.349 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.349 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.349 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.350 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:41.351 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:41.353 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:41.359 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:41.362 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1fb934e8, L:/127.0.0.1:60284 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:41.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468121369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:41.381 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085424435200001) for scanner KuduScanner(table=replication_test_table, tablet=0a7473c87ce1473fab3709d68c863dcd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:41.383 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 86e770137b663b638a7b0ce49d5c917b (4988 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:48:41.383 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [b3e1e9510333ddd4e8a43368a03d639651d7e9881b415e032c9ef46450ffd643]
23:48:41.384 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b3e1e9510333ddd4e8a43368a03d639651d7e9881b415e032c9ef46450ffd643]
23:48:41.384 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
23:48:41.384 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
23:48:41.384 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.385 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.386 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
23:48:41.386 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split a8064fec2dddf6829541a6521e99f0c5343075953df38ce45a4de7e52601d18b from pending
23:48:41.386 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 1 finished splits from enumerator state
23:48:41.387 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b3e1e9510333ddd4e8a43368a03d639651d7e9881b415e032c9ef46450ffd643 finished by subtask 0; deferring removal (restored in pending)
23:48:41.387 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9be8ea6bffe275e5e1eea1f55a8dde70868f5b214e9f657346c52cd4b22ee886'}]
23:48:41.389 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:41.389 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
23:48:41.390 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=50339fc54f264099966359f5cbc63947@[1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)[L],aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629),e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)]}]
23:48:41.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468121402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:41.411 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] connecting to peer
23:48:41.412 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:41.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
23:48:41.422 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.422 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.423 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.423 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
23:48:41.428 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] Successfully connected to peer
23:48:41.430 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.104.66
23:48:41.440 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:41.444 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf0b0bb07, L:/127.0.0.1:60298 - R:/127.7.104.66:35629] using SASL/PLAIN
23:48:41.473 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085424435200001) for scanner KuduScanner(table=replication_test_table, tablet=6ce6ef6227b04bf7b893c2f8c4d4daa1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:41.473 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [a1fe4345e978cfce0f06190e31c9adcc03f3bda122fd5179ccaa5220b293e926]
23:48:41.474 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a1fe4345e978cfce0f06190e31c9adcc03f3bda122fd5179ccaa5220b293e926]
23:48:41.474 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:48:41.474 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:48:41.475 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a1fe4345e978cfce0f06190e31c9adcc03f3bda122fd5179ccaa5220b293e926 finished by subtask 3; deferring removal (restored in pending)
23:48:41.477 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.478 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.483 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:41.483 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:41.483 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:41.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:41.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:41.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:41.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:41.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:41.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:41.484 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:41.484 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:41.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:41.485 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:41.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:41.519 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.519 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.520 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.520 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:48:41.538 [DEBUG - main] (Connection.java:575) [peer master-127.7.104.126:33577(127.7.104.126:33577)] disconnecting while in state READY
23:48:41.538 [DEBUG - main] (Connection.java:575) [peer master-127.7.104.125:36473(127.7.104.125:36473)] disconnecting while in state READY
23:48:41.538 [DEBUG - main] (Connection.java:575) [peer 1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)] disconnecting while in state READY
23:48:41.538 [DEBUG - main] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.538 [DEBUG - main] (Connection.java:575) [peer e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)] disconnecting while in state READY
23:48:41.538 [DEBUG - main] (Connection.java:575) [peer master-127.7.104.124:39307(127.7.104.124:39307)] disconnecting while in state READY
23:48:41.539 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.104.125:36473(127.7.104.125:36473)] handling channelInactive
23:48:41.539 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state READY due to: connection closed
23:48:41.539 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.104.126:33577(127.7.104.126:33577)] handling channelInactive
23:48:41.539 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state READY due to: connection closed
23:48:41.540 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)] handling channelInactive
23:48:41.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 1eabd1efdff940dbb721beb9e6190b28(127.7.104.65:45995)] cleaning up while in state READY due to: connection closed
23:48:41.540 [DEBUG - kudu-nio-4] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.540 [DEBUG - kudu-nio-4] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.541 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)] handling channelInactive
23:48:41.541 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e8d81a70facc47cfb042ee26f0f7dd02(127.7.104.67:35321)] cleaning up while in state READY due to: connection closed
23:48:41.541 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.544 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
23:48:41.545 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
23:48:41.545 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-4
23:48:41.545 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
23:48:41.546 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.546 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.104.124:39307(127.7.104.124:39307)] handling channelInactive
23:48:41.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state READY due to: connection closed
23:48:41.547 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:48:41.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:41.547482  7585 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 7870
23:48:41.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:41.567965  7994 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:41.573 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085424435200001) for scanner KuduScanner(table=replication_test_table, tablet=0dd39db2759a4265b52a1bcd82c9b355, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:41.573 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [63bfcd72721fa646634f0fa8109cb56174aef6f1e562602300c8f0fedf8407aa]
23:48:41.573 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [63bfcd72721fa646634f0fa8109cb56174aef6f1e562602300c8f0fedf8407aa]
23:48:41.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
23:48:41.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
23:48:41.574 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.575 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 63bfcd72721fa646634f0fa8109cb56174aef6f1e562602300c8f0fedf8407aa finished by subtask 2; deferring removal (restored in pending)
23:48:41.575 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.583 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:41.583 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:41.583 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:41.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:41.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:41.584 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:41.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:41.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:41.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:41.585 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:41.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:41.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:41.585 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:41.588 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.588 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:48:41.589 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:41.744585  7585 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 7870
23:48:41.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:41.749 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085424435200001) for scanner KuduScanner(table=replication_test_table, tablet=f4f3a8a917ec4959bafa5da9932eb932, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:41.750 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [5eec844d392129e43004a8e1b65c1733efa702caf82cddc3b92fb9d381dae1ec]
23:48:41.751 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5eec844d392129e43004a8e1b65c1733efa702caf82cddc3b92fb9d381dae1ec]
23:48:41.751 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
23:48:41.751 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
23:48:41.751 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.752 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5eec844d392129e43004a8e1b65c1733efa702caf82cddc3b92fb9d381dae1ec finished by subtask 1; deferring removal (restored in pending)
23:48:41.752 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085424435200001) for scanner KuduScanner(table=replication_test_table, tablet=50339fc54f264099966359f5cbc63947, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:41.753 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9be8ea6bffe275e5e1eea1f55a8dde70868f5b214e9f657346c52cd4b22ee886]
23:48:41.753 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9be8ea6bffe275e5e1eea1f55a8dde70868f5b214e9f657346c52cd4b22ee886]
23:48:41.753 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
23:48:41.753 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
23:48:41.753 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] disconnecting while in state READY
23:48:41.754 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9be8ea6bffe275e5e1eea1f55a8dde70868f5b214e9f657346c52cd4b22ee886 finished by subtask 0; deferring removal (restored in pending)
23:48:41.754 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.755 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:41.767 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.768 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.768 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
23:48:41.769 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] handling channelInactive
23:48:41.769 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aae27c6376c146569c5c33fdbdaee87d(127.7.104.66:35629)] cleaning up while in state READY due to: connection closed
23:48:41.769 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:41.769 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:48:41.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:41.787128  8024 connection.cc:573] server connection from 127.7.104.65:47699 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:41.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:41.787753  8162 connection.cc:573] client connection to 127.7.104.65:45995 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:41.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:41.787969  8162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:41.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:41.788203  7585 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8005
23:48:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:41.797869  8131 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:41.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:41.804591  8162 consensus_peers.cc:597] T 6ce6ef6227b04bf7b893c2f8c4d4daa1 P e8d81a70facc47cfb042ee26f0f7dd02 -> Peer 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995): Couldn't send request to peer 1eabd1efdff940dbb721beb9e6190b28. Status: Network error: Client connection negotiation failed: client connection to 127.7.104.65:45995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:48:41.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:41.805157  8162 consensus_peers.cc:597] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 -> Peer 1eabd1efdff940dbb721beb9e6190b28 (127.7.104.65:45995): Couldn't send request to peer 1eabd1efdff940dbb721beb9e6190b28. Status: Network error: Client connection negotiation failed: client connection to 127.7.104.65:45995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:48:41.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468121869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:41.880 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 86e770137b663b638a7b0ce49d5c917b (4320 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:41.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
23:48:41.882 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split a1fe4345e978cfce0f06190e31c9adcc03f3bda122fd5179ccaa5220b293e926 from pending
23:48:41.882 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 5eec844d392129e43004a8e1b65c1733efa702caf82cddc3b92fb9d381dae1ec from pending
23:48:41.882 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 9be8ea6bffe275e5e1eea1f55a8dde70868f5b214e9f657346c52cd4b22ee886 from pending
23:48:41.882 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split b3e1e9510333ddd4e8a43368a03d639651d7e9881b415e032c9ef46450ffd643 from pending
23:48:41.882 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 63bfcd72721fa646634f0fa8109cb56174aef6f1e562602300c8f0fedf8407aa from pending
23:48:41.882 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 5 finished splits from enumerator state
23:48:41.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468121902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:41.911 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:41.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
23:48:41.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:42.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.012329  7585 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8005
23:48:42.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:42.047328  8162 connection.cc:573] client connection to 127.7.104.66:35629 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:42.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.047739  7585 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 8146
23:48:42.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:42.049269  8162 consensus_peers.cc:597] T 0dd39db2759a4265b52a1bcd82c9b355 P e8d81a70facc47cfb042ee26f0f7dd02 -> Peer aae27c6376c146569c5c33fdbdaee87d (127.7.104.66:35629): Couldn't send request to peer aae27c6376c146569c5c33fdbdaee87d. Status: Network error: Client connection negotiation failed: client connection to 127.7.104.66:35629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:48:42.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.055367  8268 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:42.167 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:42.168 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:42.168 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:42.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:42.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:42.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:42.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:42.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:42.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:42.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:42.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:42.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:42.169 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:42.203 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:42.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.203263  7585 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 8146
23:48:42.203 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:42.204 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:42.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:42.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:42.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:42.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:42.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:42.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:42.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:42.206 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:42.206 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:42.206 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:42.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.231155  7585 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 7596
23:48:42.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.232621  7662 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:42.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:42.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.356334  7585 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 7596
23:48:42.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468122369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:42.381 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:42.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
23:48:42.383 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.104.126:33577(127.7.104.126:33577)] handling channelInactive
23:48:42.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state READY due to: connection closed
23:48:42.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.383234  7585 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 7669
23:48:42.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.384517  7733 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:42.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468122402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:42.410 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:42.411 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
23:48:42.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:42.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.502604  7585 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 7669
23:48:42.526 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.104.125:36473(127.7.104.125:36473)] handling channelInactive
23:48:42.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state READY due to: connection closed
23:48:42.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.526383  7585 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 7740
23:48:42.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.527587  7804 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:42.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:42.642669  7585 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 7740
23:48:42.662 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.104.124:39307(127.7.104.124:39307)] handling channelInactive
23:48:42.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state READY due to: connection closed
23:48:42.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:42Z chronyd exiting
23:48:42.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:42.775 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:42.775 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:42.776 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:42.776 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:42.776 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:42.776 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:42.776 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:42.776 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:42.776 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:42.776 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:42.776 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:42.776 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:42.776 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
.23:48:42.817 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468122817
23:48:42.817 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468122817
23:48:42.822 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:48:42.825 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:48:42.826 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:48:42.826 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:48:42.826 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:48:42.826 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:48:42.829 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:48:42.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468122869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:42.880 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:42.880 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
23:48:42.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468122902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:42.913 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:42.914 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
23:48:42.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:43.116 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:43.117 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:43.117 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:43.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:43.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:43.117 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:43.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:43.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:43.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:43.117 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:43.117 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:43.117 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:43.118 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:43.201 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.202 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.202 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.202 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.7.104.126:33577(127.7.104.126:33577) for tablet Kudu Master: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.205 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:43.206 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:48:43.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.208504  9510 mini_oidc.cc:150] Starting JWKS server
23:48:43.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.211103  9510 webserver.cc:534] Webserver started at http://127.0.0.1:35839/ using document root <none> and password file <none>
23:48:43.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.211342  9510 mini_oidc.cc:186] Starting OIDC Discovery server
23:48:43.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.211967  9510 webserver.cc:534] Webserver started at http://127.0.0.1:36593/ using document root <none> and password file <none>
23:48:43.225 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.225 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.226 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.227 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:43Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:48:43.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:43Z Disabled control of system clock
23:48:43.244 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.245 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.245 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.245 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.246 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.246 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.246 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.246 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.246 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.246 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.246 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.247653  9510 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:43.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:43.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/logs
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data/info.pb
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.190:40177
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.190
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:43.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35839/jwks.json with env {}
23:48:43.264 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.264 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.264 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.264 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.265 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.284 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.284 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.285 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.285 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.285 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.285 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.285 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.304 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.304 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.305 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.305 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.305 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.305 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.305 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.305 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.305 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.344 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.345 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.345 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.345 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.345 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.345 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.346 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468123369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:43.379 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:43.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
23:48:43.402 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468123402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:43.410 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:48:43.410 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
23:48:43.464 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.464 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.464 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.465 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.465 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.465 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.465 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:43.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.612310  9527 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:43.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.612692  9527 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:43.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.612776  9527 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:43.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.621603  9527 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:43.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.621699  9527 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:43.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.621760  9527 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:43.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.621801  9527 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:43.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.621853  9527 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:43.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.621887  9527 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35839/jwks.json
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.632836  9527 master_runner.cc:387] Master server non-default flags:
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.190:40177
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35839/jwks.json
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data/info.pb
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.190
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/logs
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:43.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.634593  9527 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:43.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.636713  9527 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:43.644 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:43.644 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:43.645 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:43.645 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.645 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.645 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:43.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.645 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.646 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:43.646 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.646 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.646 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:43.646 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:43.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.646761  9533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:43.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.647125  9532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:43.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.647728  9535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:43.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.649096  9527 server_base.cc:1061] running on GCE node
23:48:43.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.650012  9527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:43.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.651636  9527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:43.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.652943  9527 hybrid_clock.cc:648] HybridClock initialized: now 1783468123652812 us; error 100 us; skew 500 ppm
23:48:43.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.653426  9527 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:43.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.656148  9527 webserver.cc:534] Webserver started at http://127.9.73.190:38811/ using document root <none> and password file <none>
23:48:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.657024  9527 fs_manager.cc:362] Metadata directory not provided
23:48:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.657187  9527 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.657573  9527 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:43.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.660359  9527 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data/instance:
23:48:43.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03f23605a5954f2c94dd7056f0776108"
23:48:43.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:43 on dist-test-slave-hfsf"
23:48:43.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.661269  9527 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal/instance:
23:48:43.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03f23605a5954f2c94dd7056f0776108"
23:48:43.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:43 on dist-test-slave-hfsf"
23:48:43.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.667402  9527 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
23:48:43.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.671502  9541 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:43.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.673208  9527 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
23:48:43.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.673434  9527 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal
23:48:43.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03f23605a5954f2c94dd7056f0776108"
23:48:43.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:43 on dist-test-slave-hfsf"
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.673717  9527 fs_report.cc:389] FS layout report
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data/data
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:43.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:43.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.705617  9527 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:43.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.706625  9527 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:43.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.706957  9527 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:43.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.729323  9527 rpc_server.cc:307] RPC server started. Bound to: 127.9.73.190:40177
23:48:43.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.729359  9592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.73.190:40177 every 8 connection(s)
23:48:43.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.731020  9527 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/data/info.pb
23:48:43.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.736073  9593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:43.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.738571  9510 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 9527
23:48:43.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.739003  9510 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-0/wal/instance
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.742182  9510 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/logs
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data/info.pb
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.189:33103
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.189
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:43.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35839/jwks.json with env {}
23:48:43.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.745587  9593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } has no permanent_uuid. Determining permanent_uuid...
23:48:43.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:43.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.767990  9593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } has no permanent_uuid. Determining permanent_uuid...
23:48:43.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.769586  9544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.73.189:33103: connect: Connection refused (error 111)
23:48:43.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.771416  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.189:33103: Network error: Client connection negotiation failed: client connection to 127.9.73.189:33103: connect: Connection refused (error 111)
23:48:43.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.820792  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } attempt: 1
23:48:43.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.823191  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.189:33103: Network error: Client connection negotiation failed: client connection to 127.9.73.189:33103: connect: Connection refused (error 111)
23:48:43.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468123869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:43.879 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:43.880 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
23:48:43.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.891475  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } attempt: 2
23:48:43.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.893620  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.189:33103: Network error: Client connection negotiation failed: client connection to 127.9.73.189:33103: connect: Connection refused (error 111)
23:48:43.902 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468123902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:43.910 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:43.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
23:48:43.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:43.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:43.985033  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } attempt: 3
23:48:43.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:43.987835  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.189:33103: Network error: Client connection negotiation failed: client connection to 127.9.73.189:33103: connect: Connection refused (error 111)
23:48:44.024 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:44.025 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:44.025 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:44.025 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:44.025 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:44.025 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:44.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:44.026 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:44.026 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:44.026 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:44.026 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:44.026 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:44.026 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:44.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.128851  9595 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:44.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.129225  9595 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:44.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.129309  9595 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:44.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.131119  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } attempt: 4
23:48:44.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.133694  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.189:33103: Network error: Client connection negotiation failed: client connection to 127.9.73.189:33103: connect: Connection refused (error 111)
23:48:44.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.138929  9595 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:44.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.139027  9595 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:44.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.139083  9595 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:44.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.139128  9595 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:44.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.139181  9595 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:44.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.139240  9595 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35839/jwks.json
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.150259  9595 master_runner.cc:387] Master server non-default flags:
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.189:33103
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35839/jwks.json
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data/info.pb
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.189
23:48:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/logs
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:44.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:44.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.152134  9595 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:44.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.154048  9595 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:44.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.163682  9606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:44.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.163684  9603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:44.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.164103  9604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:44.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.164633  9595 server_base.cc:1061] running on GCE node
23:48:44.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.165617  9595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:44.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.167312  9595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:44.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.168586  9595 hybrid_clock.cc:648] HybridClock initialized: now 1783468124168543 us; error 36 us; skew 500 ppm
23:48:44.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.169000  9595 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:44.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.171708  9595 webserver.cc:534] Webserver started at http://127.9.73.189:40943/ using document root <none> and password file <none>
23:48:44.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.172541  9595 fs_manager.cc:362] Metadata directory not provided
23:48:44.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.172688  9595 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:44.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.173043  9595 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.175734  9595 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data/instance:
23:48:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "12579d04adc04dfeacf6a82aae8b6da1"
23:48:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:44 on dist-test-slave-hfsf"
23:48:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.176614  9595 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal/instance:
23:48:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "12579d04adc04dfeacf6a82aae8b6da1"
23:48:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:44 on dist-test-slave-hfsf"
23:48:44.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.183041  9595 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
23:48:44.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.186825  9612 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:44.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.188465  9595 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.188681  9595 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "12579d04adc04dfeacf6a82aae8b6da1"
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:44 on dist-test-slave-hfsf"
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.188957  9595 fs_report.cc:389] FS layout report
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data/data
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:44.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.214324  9595 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:44.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.215435  9595 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:44.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.215782  9595 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:44.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.237540  9595 rpc_server.cc:307] RPC server started. Bound to: 127.9.73.189:33103
23:48:44.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.237561  9663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.73.189:33103 every 8 connection(s)
23:48:44.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.239234  9595 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/data/info.pb
23:48:44.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.243842  9664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:44.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.245680  9510 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 9595
23:48:44.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.245864  9510 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-1/wal/instance
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.247251  9510 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/logs
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data/info.pb
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.188:35043
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.188
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:44.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:44.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35839/jwks.json with env {}
23:48:44.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:44.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.252801  9664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.267439  9664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.277664  9664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.279134  9613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.281225  9664 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.304 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:44.304 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:44.305 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:44.305 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:44.305 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:44.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:44.305 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:44.305 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:44.305 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:44.305 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:44.305 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:44.305 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:44.305 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:44.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.330514  9664 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 1
23:48:44.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.333212  9664 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468124369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:44.381 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:44.384 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
23:48:44.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.401458  9664 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 2
23:48:44.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468124402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:44.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.404425  9664 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.411 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:44.412 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
23:48:44.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.432991  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } attempt: 5
23:48:44.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.441434  9593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.443620  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.462 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:44.463 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:44.463 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:44.463 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.463 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.463 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.464 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:44.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.494892  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 1
23:48:44.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.495697  9664 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 3
23:48:44.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.497457  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.497764  9664 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.565722  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 2
23:48:44.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.567852  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.620903  9666 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:44.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.621213  9666 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:44.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.621299  9666 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:44.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.630025  9666 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:44.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.630124  9666 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:44.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.630180  9666 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:44.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.630220  9666 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:44.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.630272  9666 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:44.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.630306  9666 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35839/jwks.json
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.640995  9664 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 4
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.641206  9666 master_runner.cc:387] Master server non-default flags:
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.188:35043
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35839/jwks.json
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data/info.pb
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.188
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/logs
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:44.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:44.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:44.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.643227  9664 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.643458  9666 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:44.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.645468  9666 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:44.648 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:44.648 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:44.648 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:44.648 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.649 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.649 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.649 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.649 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.649 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.649 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.649 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.649 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.649 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:44.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.654452  9675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:44.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.655203  9674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:44.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.655581  9677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:44.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.656813  9666 server_base.cc:1061] running on GCE node
23:48:44.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.657722  9666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:44.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.659374  9666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:44.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.660637  9666 hybrid_clock.cc:648] HybridClock initialized: now 1783468124660573 us; error 56 us; skew 500 ppm
23:48:44.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.661041  9666 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:44.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.663506  9666 webserver.cc:534] Webserver started at http://127.9.73.188:38453/ using document root <none> and password file <none>
23:48:44.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.664381  9666 fs_manager.cc:362] Metadata directory not provided
23:48:44.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.664572  9666 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:44.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.665021  9666 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:44.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.667713  9666 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data/instance:
23:48:44.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c05d2feb937346c9806d63b32c73d2bf"
23:48:44.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:44 on dist-test-slave-hfsf"
23:48:44.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.668586  9666 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal/instance:
23:48:44.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c05d2feb937346c9806d63b32c73d2bf"
23:48:44.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:44 on dist-test-slave-hfsf"
23:48:44.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.674103  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 3
23:48:44.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.674572  9666 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
23:48:44.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.676154  9593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.73.188:35043: Network error: Client connection negotiation failed: client connection to 127.9.73.188:35043: connect: Connection refused (error 111)
23:48:44.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.678547  9683 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.680218  9666 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.680366  9666 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c05d2feb937346c9806d63b32c73d2bf"
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:44 on dist-test-slave-hfsf"
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.680568  9666 fs_report.cc:389] FS layout report
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data/data
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:44.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:44.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:44.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:44.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:44.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:44.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:44.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.701179  9666 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:44.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.702085  9666 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:44.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.702339  9666 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:44.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.726001  9666 rpc_server.cc:307] RPC server started. Bound to: 127.9.73.188:35043
23:48:44.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.726050  9734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.73.188:35043 every 8 connection(s)
23:48:44.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.727783  9666 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/data/info.pb
23:48:44.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.732508  9510 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 9666
23:48:44.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.732714  9510 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/master-2/wal/instance
23:48:44.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.733242  9735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:44.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.741875  9735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:44.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.757638  9735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.765224  9735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } has no permanent_uuid. Determining permanent_uuid...
23:48:44.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.776054  9735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: Bootstrap starting.
23:48:44.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.780049  9735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: Neither blocks nor log segments found. Creating new log.
23:48:44.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.781246  9735 log.cc:826] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: Log is configured to *not* fsync() on all Append() calls
23:48:44.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.784911  9735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: No bootstrap required, opened a new log
23:48:44.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.791276  9735 raft_consensus.cc:359] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:44.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.791595  9735 raft_consensus.cc:385] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:44.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.791752  9735 raft_consensus.cc:740] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c05d2feb937346c9806d63b32c73d2bf, State: Initialized, Role: FOLLOWER
23:48:44.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.792333  9735 consensus_queue.cc:260] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:44.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.793290  9742 sys_catalog.cc:455] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:44.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.793542  9742 sys_catalog.cc:458] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: This master's current role is: FOLLOWER
23:48:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.794406  9735 sys_catalog.cc:565] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: configured and running, proceeding with master startup.
23:48:44.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.805904  9753 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:44.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.806080  9753 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:44.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.802618  9666 master_runner.cc:187] Error getting master registration for 127.9.73.190:40177: OK, instance_id { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" instance_seqno: 1783468123723136 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:44.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.808732  9666 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:44.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.853407  9593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 4
23:48:44.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.868314  9593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: Bootstrap starting.
23:48:44.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468124869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:44.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.872947  9593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: Neither blocks nor log segments found. Creating new log.
23:48:44.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.879994  9593 log.cc:826] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: Log is configured to *not* fsync() on all Append() calls
23:48:44.881 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:44.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
23:48:44.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.890300  9593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: No bootstrap required, opened a new log
23:48:44.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.899187  9593 raft_consensus.cc:359] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:44.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.899636  9593 raft_consensus.cc:385] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:44.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.899829  9593 raft_consensus.cc:740] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f23605a5954f2c94dd7056f0776108, State: Initialized, Role: FOLLOWER
23:48:44.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.900650  9593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:44.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.901870  9756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:44.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.902627  9756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: This master's current role is: FOLLOWER
23:48:44.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468124902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:44.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.903507  9593 sys_catalog.cc:565] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: configured and running, proceeding with master startup.
23:48:44.920 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
23:48:44.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
23:48:44.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.942462  9664 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } attempt: 5
23:48:44.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.955374  9689 tablet.cc:2406] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:44.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.959106  9767 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:44.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.959249  9767 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:44.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:44.960170  9547 tablet.cc:2406] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.957105  9527 master_runner.cc:187] Error getting master registration for 127.9.73.189:33103: OK, instance_id { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" instance_seqno: 1783468124231709 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.964223  9527 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:44.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.964275  9664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: Bootstrap starting.
23:48:44.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.968604  9664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: Neither blocks nor log segments found. Creating new log.
23:48:44.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.970079  9664 log.cc:826] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: Log is configured to *not* fsync() on all Append() calls
23:48:44.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.977641  9664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: No bootstrap required, opened a new log
23:48:44.983 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:44.983 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:44.984 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:44.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:44.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:44.984 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.984 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.984 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:44.984 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:44.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.987372  9664 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:44.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.987751  9664 raft_consensus.cc:385] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:44.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.987871  9664 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12579d04adc04dfeacf6a82aae8b6da1, State: Initialized, Role: FOLLOWER
23:48:44.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.988624  9664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:44.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.989778  9770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:44.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.990294  9770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: This master's current role is: FOLLOWER
23:48:44.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:44.991119  9664 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: configured and running, proceeding with master startup.
23:48:44.991 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:45.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.057828  9595 master_runner.cc:264] No leader master found from master 12579d04adc04dfeacf6a82aae8b6da1
23:48:45.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.057999  9595 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:45.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.061230  9781 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:45.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.061406  9781 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:45.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.209033  9756 raft_consensus.cc:493] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:45.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.209422  9756 raft_consensus.cc:515] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:45.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.212212  9756 leader_election.cc:290] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12579d04adc04dfeacf6a82aae8b6da1 (127.9.73.189:33103), c05d2feb937346c9806d63b32c73d2bf (127.9.73.188:35043)
23:48:45.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.213693  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03f23605a5954f2c94dd7056f0776108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12579d04adc04dfeacf6a82aae8b6da1" is_pre_election: true
23:48:45.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.214349  9639 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f23605a5954f2c94dd7056f0776108 in term 0.
23:48:45.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.215428  9544 leader_election.cc:304] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f23605a5954f2c94dd7056f0776108, 12579d04adc04dfeacf6a82aae8b6da1; no voters: 
23:48:45.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.217234  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03f23605a5954f2c94dd7056f0776108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c05d2feb937346c9806d63b32c73d2bf" is_pre_election: true
23:48:45.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.217829  9710 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03f23605a5954f2c94dd7056f0776108 in term 0.
23:48:45.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.218550  9618 tablet.cc:2406] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:45.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.218679  9756 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:45.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.219604  9756 raft_consensus.cc:493] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:45.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.219735  9756 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 0 FOLLOWER]: Advancing to term 1
23:48:45.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.223693  9756 raft_consensus.cc:515] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:45.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.225838  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03f23605a5954f2c94dd7056f0776108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12579d04adc04dfeacf6a82aae8b6da1"
23:48:45.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.226114  9639 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 0 FOLLOWER]: Advancing to term 1
23:48:45.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.230648  9639 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f23605a5954f2c94dd7056f0776108 in term 1.
23:48:45.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.230648  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03f23605a5954f2c94dd7056f0776108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c05d2feb937346c9806d63b32c73d2bf"
23:48:45.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.230950  9710 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 0 FOLLOWER]: Advancing to term 1
23:48:45.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.231566  9544 leader_election.cc:304] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f23605a5954f2c94dd7056f0776108, 12579d04adc04dfeacf6a82aae8b6da1; no voters: 
23:48:45.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.235538  9710 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03f23605a5954f2c94dd7056f0776108 in term 1.
23:48:45.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.236572  9756 leader_election.cc:290] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [CANDIDATE]: Term 1 election: Requested vote from peers 12579d04adc04dfeacf6a82aae8b6da1 (127.9.73.189:33103), c05d2feb937346c9806d63b32c73d2bf (127.9.73.188:35043)
23:48:45.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.238757  9756 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 1 FOLLOWER]: Leader election won for term 1
23:48:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.239156  9756 raft_consensus.cc:697] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [term 1 LEADER]: Becoming Leader. State: Replica: 03f23605a5954f2c94dd7056f0776108, State: Running, Role: LEADER
23:48:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.241287  9756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } }
23:48:45.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:45.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.255342  9783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f23605a5954f2c94dd7056f0776108. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.256350  9783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: This master's current role is: LEADER
23:48:45.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.263993  9785 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:48:45.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.266933  9785 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:48:45.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.289829  9710 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [term 1 FOLLOWER]: Refusing update from remote peer 03f23605a5954f2c94dd7056f0776108: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:45.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.291517  9783 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:45.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.300180  9639 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [term 1 FOLLOWER]: Refusing update from remote peer 03f23605a5954f2c94dd7056f0776108: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:45.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.306635  9783 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:45.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.328022  9770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f23605a5954f2c94dd7056f0776108. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.328382  9770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: This master's current role is: FOLLOWER
23:48:45.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.334976  9786 mvcc.cc:204] Tried to move back new op lower bound from 7305085441171779584 to 7305085441002610688. Current Snapshot: MvccSnapshot[applied={T|T < 7305085441171779584}]
23:48:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.340955  9770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.341241  9770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1 [sys.catalog]: This master's current role is: FOLLOWER
23:48:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.346895  9756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.347297  9756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: This master's current role is: LEADER
23:48:45.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.350723  9785 catalog_manager.cc:1382] Generated new cluster ID: 00cca0ddfc754e34830f9eef1c229450
23:48:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.350888  9785 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:48:45.364 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:45.364 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:45.364 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:45.365 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:45.365 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:45.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:45.365 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:45.365 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:45.365 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:45.365 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:45.365 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:45.365 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:45.365 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:45.369 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468125369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:45.383 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:45.383 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:45.383 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:45.383 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:45.383 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:45.384 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:45.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:45.384 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:45.384 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:45.385 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:45.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:45.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:45.385 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:45.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.388065  9756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.388664  9756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108 [sys.catalog]: This master's current role is: LEADER
23:48:45.389 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
23:48:45.391 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
23:48:45.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.399793  9787 sys_catalog.cc:455] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f23605a5954f2c94dd7056f0776108. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.400166  9787 sys_catalog.cc:458] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: This master's current role is: FOLLOWER
23:48:45.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.401338  9794 sys_catalog.cc:455] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03f23605a5954f2c94dd7056f0776108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03f23605a5954f2c94dd7056f0776108" member_type: VOTER last_known_addr { host: "127.9.73.190" port: 40177 } } peers { permanent_uuid: "12579d04adc04dfeacf6a82aae8b6da1" member_type: VOTER last_known_addr { host: "127.9.73.189" port: 33103 } } peers { permanent_uuid: "c05d2feb937346c9806d63b32c73d2bf" member_type: VOTER last_known_addr { host: "127.9.73.188" port: 35043 } } }
23:48:45.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.401678  9794 sys_catalog.cc:458] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf [sys.catalog]: This master's current role is: FOLLOWER
23:48:45.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468125402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:45.417 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
23:48:45.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
23:48:45.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.419631  9785 catalog_manager.cc:1405] Generated new certificate authority record
23:48:45.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.421430  9785 catalog_manager.cc:1539] Loading token signing keys...
23:48:45.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.442276  9785 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 03f23605a5954f2c94dd7056f0776108: Generated new TSK 0
23:48:45.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.443714  9785 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:48:45.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.485796  9510 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/logs
23:48:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data/info.pb
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.129:0
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.73.129
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.129
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:45.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:45.544 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:45.544 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:45.544 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:45.545 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:45.545 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:45.545 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:45.546 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:45.546 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:45.546 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:45.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:45.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:45.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:45.547 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:45.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:45.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.808250  9753 catalog_manager.cc:1294] Loaded cluster ID: 00cca0ddfc754e34830f9eef1c229450
23:48:45.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.808367  9753 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: loading cluster ID for follower catalog manager: success
23:48:45.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.811849  9753 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: acquiring CA information for follower catalog manager: success
23:48:45.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.813954  9753 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c05d2feb937346c9806d63b32c73d2bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:45.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468125869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:45.877 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:48:45.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
23:48:45.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.880553  9797 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:45.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.881019  9797 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:45.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.881155  9797 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:45.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.894155  9797 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:45.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.894387  9797 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.73.129
23:48:45.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468125902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.907191  9797 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.129:0
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data/info.pb
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.129
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:45.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.73.129
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/logs
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:45.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:45.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.909548  9797 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:45.911 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:45.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.911957  9797 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:45.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
23:48:45.923 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:45.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.923365  9805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:45.923 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:45.924 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:45.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:45.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:45.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:45.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:45.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:45.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:45.924 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:45.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:45.924 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:45.924 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.927348  9803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:45.927600  9802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:45.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.928635  9797 server_base.cc:1061] running on GCE node
23:48:45.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.929450  9797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:45.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.930682  9797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:45.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.931910  9797 hybrid_clock.cc:648] HybridClock initialized: now 1783468125931811 us; error 92 us; skew 500 ppm
23:48:45.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.932288  9797 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:45.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.934693  9797 webserver.cc:534] Webserver started at http://127.9.73.129:37615/ using document root <none> and password file <none>
23:48:45.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.935822  9797 fs_manager.cc:362] Metadata directory not provided
23:48:45.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.936075  9797 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:45.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.936524  9797 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:45.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.939246  9797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data/instance:
23:48:45.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a42ee4c8ed30413397629819d068081b"
23:48:45.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:45 on dist-test-slave-hfsf"
23:48:45.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.940209  9797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal/instance:
23:48:45.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a42ee4c8ed30413397629819d068081b"
23:48:45.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:45 on dist-test-slave-hfsf"
23:48:45.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.946439  9797 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
23:48:45.948 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:45.948 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:45.948 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:45.948 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:45.948 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:45.949 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:45.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:45.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:45.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:45.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:45.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:45.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:45.949 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:45.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.950891  9811 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:45.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.952428  9797 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
23:48:45.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.952579  9797 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal
23:48:45.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a42ee4c8ed30413397629819d068081b"
23:48:45.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:45 on dist-test-slave-hfsf"
23:48:45.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.952768  9797 fs_report.cc:389] FS layout report
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data/data
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:45.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:45.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.988801  9797 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.989799  9797 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:45.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.990049  9797 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:45.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.991235  9797 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:45.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.993299  9797 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:45.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.993400  9797 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:45.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.993481  9797 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:45.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:45.993530  9797 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:46.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.029702  9797 rpc_server.cc:307] RPC server started. Bound to: 127.9.73.129:34153
23:48:46.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.029747  9923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.73.129:34153 every 8 connection(s)
23:48:46.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.031417  9797 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/data/info.pb
23:48:46.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.033473  9510 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 9797
23:48:46.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.033721  9510 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-0/wal/instance
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.048877  9510 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/logs
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data/info.pb
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.130:0
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.73.130
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.130
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:46.064 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:46.064 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:46.064 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:46.065 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:46.065 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:46.065 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:46.065 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:46.065 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:46.065 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:46.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.064496  9781 catalog_manager.cc:1294] Loaded cluster ID: 00cca0ddfc754e34830f9eef1c229450
23:48:46.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.064603  9781 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: loading cluster ID for follower catalog manager: success
23:48:46.065 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:46.066 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:46.066 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:46.066 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:46.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.068629  9781 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: acquiring CA information for follower catalog manager: success
23:48:46.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.069424  9926 heartbeater.cc:344] Connected to a master server at 127.9.73.189:33103
23:48:46.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.069846  9926 heartbeater.cc:461] Registering TS with master...
23:48:46.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.071007  9926 heartbeater.cc:507] Master 127.9.73.189:33103 requested a full tablet report, sending...
23:48:46.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.071220  9781 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 12579d04adc04dfeacf6a82aae8b6da1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.072049  9925 heartbeater.cc:344] Connected to a master server at 127.9.73.190:40177
23:48:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.072198  9925 heartbeater.cc:461] Registering TS with master...
23:48:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.072762  9925 heartbeater.cc:507] Master 127.9.73.190:40177 requested a full tablet report, sending...
23:48:46.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.073927  9628 ts_manager.cc:194] Registered new tserver with Master: a42ee4c8ed30413397629819d068081b (127.9.73.129:34153)
23:48:46.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.074668  9558 ts_manager.cc:194] Registered new tserver with Master: a42ee4c8ed30413397629819d068081b (127.9.73.129:34153)
23:48:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.076185  9924 heartbeater.cc:344] Connected to a master server at 127.9.73.188:35043
23:48:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.076303  9924 heartbeater.cc:461] Registering TS with master...
23:48:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.076270  9558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.73.129:48989
23:48:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.076709  9924 heartbeater.cc:507] Master 127.9.73.188:35043 requested a full tablet report, sending...
23:48:46.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.078907  9700 ts_manager.cc:194] Registered new tserver with Master: a42ee4c8ed30413397629819d068081b (127.9.73.129:34153)
23:48:46.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:46.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468126369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:46.378 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:46.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
23:48:46.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468126402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:46.417 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:48:46.417 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
23:48:46.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.450934  9934 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:46.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.451412  9934 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:46.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.451546  9934 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:46.455 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:46.456 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:46.456 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:46.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:46.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:46.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:46.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:46.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:46.457 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:46.457 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:46.457 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:46.457 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:46.457 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:46.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.465763  9934 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:46.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.466032  9934 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.73.130
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.483042  9934 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.130:0
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data/info.pb
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.130
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.73.130
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/logs
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:46.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:46.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:46.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:46.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.485678  9934 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:46.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:46.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.488418  9934 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:46.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.501806  9942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:46.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.501798  9940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:46.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:46.502358  9939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:46.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.503010  9934 server_base.cc:1061] running on GCE node
23:48:46.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.503665  9934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:46.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.504885  9934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:46.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.506141  9934 hybrid_clock.cc:648] HybridClock initialized: now 1783468126506098 us; error 40 us; skew 500 ppm
23:48:46.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.506512  9934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.509258  9934 webserver.cc:534] Webserver started at http://127.9.73.130:41983/ using document root <none> and password file <none>
23:48:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.510197  9934 fs_manager.cc:362] Metadata directory not provided
23:48:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.510351  9934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.510761  9934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.513589  9934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data/instance:
23:48:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "77ab6d3c9b044d9c88d6a81463114967"
23:48:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:46 on dist-test-slave-hfsf"
23:48:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.514520  9934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal/instance:
23:48:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "77ab6d3c9b044d9c88d6a81463114967"
23:48:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:46 on dist-test-slave-hfsf"
23:48:46.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.521577  9934 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.001s
23:48:46.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.527067  9948 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.529036  9934 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.529284  9934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "77ab6d3c9b044d9c88d6a81463114967"
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:46 on dist-test-slave-hfsf"
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.529587  9934 fs_report.cc:389] FS layout report
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data/data
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:46.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.550681  9934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:46.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.551936  9934 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:46.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.552467  9934 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:46.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.553602  9934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.555616  9934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.555750  9934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.555860  9934 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:46.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.555971  9934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:46.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.598445  9934 rpc_server.cc:307] RPC server started. Bound to: 127.9.73.130:43935
23:48:46.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.598500 10060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.73.130:43935 every 8 connection(s)
23:48:46.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.600134  9934 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/data/info.pb
23:48:46.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.609006  9510 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 9934
23:48:46.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.609275  9510 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-1/wal/instance
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.617923  9510 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/logs
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data/info.pb
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.131:0
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.73.131
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.131
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:46.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.640223 10061 heartbeater.cc:344] Connected to a master server at 127.9.73.188:35043
23:48:46.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.640288 10062 heartbeater.cc:344] Connected to a master server at 127.9.73.190:40177
23:48:46.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.640702 10062 heartbeater.cc:461] Registering TS with master...
23:48:46.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.640702 10061 heartbeater.cc:461] Registering TS with master...
23:48:46.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.642010 10061 heartbeater.cc:507] Master 127.9.73.188:35043 requested a full tablet report, sending...
23:48:46.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.642033 10062 heartbeater.cc:507] Master 127.9.73.190:40177 requested a full tablet report, sending...
23:48:46.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.642576 10063 heartbeater.cc:344] Connected to a master server at 127.9.73.189:33103
23:48:46.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.642743 10063 heartbeater.cc:461] Registering TS with master...
23:48:46.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.643411 10063 heartbeater.cc:507] Master 127.9.73.189:33103 requested a full tablet report, sending...
23:48:46.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.644269  9700 ts_manager.cc:194] Registered new tserver with Master: 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935)
23:48:46.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.644603  9628 ts_manager.cc:194] Registered new tserver with Master: 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935)
23:48:46.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.644976  9558 ts_manager.cc:194] Registered new tserver with Master: 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935)
23:48:46.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:46.646327  9558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.73.130:37817
23:48:46.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:46.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468126869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:46.881 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:46.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
23:48:46.902 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468126902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:46.912 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:46.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
23:48:46.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:47.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.007946 10071 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:47.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.008296 10071 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:47.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.008384 10071 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:47.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.018199 10071 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:47.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.018385 10071 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.73.131
23:48:47.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.030514 10071 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:47.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:47.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.73.148:41657
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.73.131:0
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data/info.pb
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.73.131
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.73.190:40177,127.9.73.189:33103,127.9.73.188:35043
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.73.131
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/logs
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:47.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:47.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.032289 10071 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:47.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.034210 10071 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:47.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.045740 10077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:47.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.045921 10076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:47.047209 10079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:47.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.048027 10071 server_base.cc:1061] running on GCE node
23:48:47.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.048749 10071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:47.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.049860 10071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:47.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.051100 10071 hybrid_clock.cc:648] HybridClock initialized: now 1783468127051028 us; error 60 us; skew 500 ppm
23:48:47.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.051462 10071 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.053812 10071 webserver.cc:534] Webserver started at http://127.9.73.131:45721/ using document root <none> and password file <none>
23:48:47.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.054682 10071 fs_manager.cc:362] Metadata directory not provided
23:48:47.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.054845 10071 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:47.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.055279 10071 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:47.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.058007 10071 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data/instance:
23:48:47.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a06e574087eb4f62863affbc0d2d5eaf"
23:48:47.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:47 on dist-test-slave-hfsf"
23:48:47.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.059023 10071 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal/instance:
23:48:47.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a06e574087eb4f62863affbc0d2d5eaf"
23:48:47.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:47 on dist-test-slave-hfsf"
23:48:47.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.064824 10071 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
23:48:47.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.069109 10085 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:47.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.070657 10071 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.071031 10071 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a06e574087eb4f62863affbc0d2d5eaf"
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:47 on dist-test-slave-hfsf"
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.071286 10071 fs_report.cc:389] FS layout report
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data/data
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:47.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:47.076 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:47.076 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:47.076 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:47.077 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.077 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.077 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:47.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.078953  9925 heartbeater.cc:499] Master 127.9.73.190:40177 was elected leader, sending a full tablet report...
23:48:47.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.096750 10071 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:47.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.097743 10071 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:47.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.098085 10071 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:47.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.099325 10071 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:47.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.101328 10071 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:47.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.101424 10071 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:47.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.101504 10071 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:47.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.101555 10071 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:47.115 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:47.116 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:47.116 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:47.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:47.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:47.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:47.116 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:47.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:47.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:47.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:47.117 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:47.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:47.117 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:47.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.144515 10071 rpc_server.cc:307] RPC server started. Bound to: 127.9.73.131:40785
23:48:47.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.144572 10197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.73.131:40785 every 8 connection(s)
23:48:47.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.146267 10071 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/data/info.pb
23:48:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.150733  9510 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10071
23:48:47.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.151116  9510 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16766636912559750667/ts-2/wal/instance
23:48:47.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.178220 10200 heartbeater.cc:344] Connected to a master server at 127.9.73.189:33103
23:48:47.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.178692 10200 heartbeater.cc:461] Registering TS with master...
23:48:47.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.179865 10200 heartbeater.cc:507] Master 127.9.73.189:33103 requested a full tablet report, sending...
23:48:47.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.181746  9628 ts_manager.cc:194] Registered new tserver with Master: a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:47.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.191440 10198 heartbeater.cc:344] Connected to a master server at 127.9.73.188:35043
23:48:47.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.191888 10198 heartbeater.cc:461] Registering TS with master...
23:48:47.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.192576 10198 heartbeater.cc:507] Master 127.9.73.188:35043 requested a full tablet report, sending...
23:48:47.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.193670 10199 heartbeater.cc:344] Connected to a master server at 127.9.73.190:40177
23:48:47.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.193827 10199 heartbeater.cc:461] Registering TS with master...
23:48:47.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.194160  9700 ts_manager.cc:194] Registered new tserver with Master: a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:47.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.194315 10199 heartbeater.cc:507] Master 127.9.73.190:40177 requested a full tablet report, sending...
23:48:47.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.195513  9557 ts_manager.cc:194] Registered new tserver with Master: a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:47.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.196508  9557 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.73.131:51941
23:48:47.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.211211  9510 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:47.213 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:47.213 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:47.214 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.73.190"
      port: 40177
    }
    bound_http_address {
      host: "127.9.73.190"
      port: 38811
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.73.189"
      port: 33103
    }
    bound_http_address {
      host: "127.9.73.189"
      port: 40943
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.73.188"
      port: 35043
    }
    bound_http_address {
      host: "127.9.73.188"
      port: 38453
    }
  }
}

23:48:47.215 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:47.215 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.73.129"
      port: 34153
    }
    bound_http_address {
      host: "127.9.73.129"
      port: 37615
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.73.130"
      port: 43935
    }
    bound_http_address {
      host: "127.9.73.130"
      port: 41983
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.73.131"
      port: 40785
    }
    bound_http_address {
      host: "127.9.73.131"
      port: 45721
    }
  }
}

23:48:47.216 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:47.217 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:47.217 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:48:47.217 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:48:47.217 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:48:47.217 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:48:47.221 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:48:47.247 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:47.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468127369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:47.377 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:48:47.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
23:48:47.402 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468127402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:47.425 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
23:48:47.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
23:48:47.447 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:47.448 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:47.448 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:47.448 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.449 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.449 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.449 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.449 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.449 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.449 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.449 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.449 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.449 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:47.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:47.593 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:47.593 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:48:47.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.596061 10208 mini_oidc.cc:150] Starting JWKS server
23:48:47.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.598703 10208 webserver.cc:534] Webserver started at http://127.0.0.1:40071/ using document root <none> and password file <none>
23:48:47.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.599045 10208 mini_oidc.cc:186] Starting OIDC Discovery server
23:48:47.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.599699 10208 webserver.cc:534] Webserver started at http://127.0.0.1:45063/ using document root <none> and password file <none>
23:48:47.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:47Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:48:47.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:47Z Disabled control of system clock
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.633370 10208 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/logs
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data/info.pb
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.62:39393
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.62
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40071/jwks.json with env {}
23:48:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:47.649493 10062 heartbeater.cc:499] Master 127.9.73.190:40177 was elected leader, sending a full tablet report...
23:48:47.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:47.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468127869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:47.880 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:47.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
23:48:47.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468127902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:47.914 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:47.914 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
23:48:47.976 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:47.976 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:47.977 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:47.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:47.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.977 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.977 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:47.977 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:47.977 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:47.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:48.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.013885 10219 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:48.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.014258 10219 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:48.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.014344 10219 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.023301 10219 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.023403 10219 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.023458 10219 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.023501 10219 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.023555 10219 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.023589 10219 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40071/jwks.json
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.036175 10219 master_runner.cc:387] Master server non-default flags:
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.62:39393
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40071/jwks.json
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data/info.pb
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.62
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/logs
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:48.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:48.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.037928 10219 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:48.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.040028 10219 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:48.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.050097 10224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:48.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.050508 10225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:48.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.051120 10219 server_base.cc:1061] running on GCE node
23:48:48.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.051338 10227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:48.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.052295 10219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:48.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.053961 10219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:48.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.055287 10219 hybrid_clock.cc:648] HybridClock initialized: now 1783468128055172 us; error 97 us; skew 500 ppm
23:48:48.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.055642 10219 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:48.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.058571 10219 webserver.cc:534] Webserver started at http://127.9.248.62:35899/ using document root <none> and password file <none>
23:48:48.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.059513 10219 fs_manager.cc:362] Metadata directory not provided
23:48:48.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.059649 10219 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:48.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.060066 10219 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.062711 10219 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data/instance:
23:48:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "923ce0926ecd41c597a7a7d362b7c2ac"
23:48:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:48 on dist-test-slave-hfsf"
23:48:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.063735 10219 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal/instance:
23:48:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "923ce0926ecd41c597a7a7d362b7c2ac"
23:48:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:48 on dist-test-slave-hfsf"
23:48:48.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.071743 10219 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
23:48:48.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.083983 10233 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:48.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.086246 10219 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.005s	sys 0.000s
23:48:48.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.086516 10219 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal
23:48:48.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "923ce0926ecd41c597a7a7d362b7c2ac"
23:48:48.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:48 on dist-test-slave-hfsf"
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.086796 10219 fs_report.cc:389] FS layout report
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data/data
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:48.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:48.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.101809 10219 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:48.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.103032 10219 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:48.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.103345 10219 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:48.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.125929 10219 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.62:39393
23:48:48.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.125895 10284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.62:39393 every 8 connection(s)
23:48:48.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.128079 10219 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/data/info.pb
23:48:48.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.133183 10285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:48.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.133711 10208 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10219
23:48:48.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.134057 10208 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-0/wal/instance
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.136580 10208 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:48.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/logs
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data/info.pb
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.61:36251
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.61
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:48.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40071/jwks.json with env {}
23:48:48.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.140682 10285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } has no permanent_uuid. Determining permanent_uuid...
23:48:48.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.168860 10285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } has no permanent_uuid. Determining permanent_uuid...
23:48:48.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.170145 10235 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.248.61:36251: connect: Connection refused (error 111)
23:48:48.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.171942 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.61:36251: Network error: Client connection negotiation failed: client connection to 127.9.248.61:36251: connect: Connection refused (error 111)
23:48:48.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.199090 10199 heartbeater.cc:499] Master 127.9.73.190:40177 was elected leader, sending a full tablet report...
23:48:48.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.221275 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } attempt: 1
23:48:48.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.223783 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.61:36251: Network error: Client connection negotiation failed: client connection to 127.9.248.61:36251: connect: Connection refused (error 111)
23:48:48.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.292137 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } attempt: 2
23:48:48.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.294521 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.61:36251: Network error: Client connection negotiation failed: client connection to 127.9.248.61:36251: connect: Connection refused (error 111)
23:48:48.363 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:48.364 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:48.364 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:48.364 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:48.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:48.364 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:48.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:48.364 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:48.364 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:48.364 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:48.365 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:48.365 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:48.365 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:48.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468128369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:48.379 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:48.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
23:48:48.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.385799 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } attempt: 3
23:48:48.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.388410 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.61:36251: Network error: Client connection negotiation failed: client connection to 127.9.248.61:36251: connect: Connection refused (error 111)
23:48:48.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468128402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:48.410 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:48.411 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
23:48:48.483 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:48.483 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:48.483 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:48.484 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:48.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:48.484 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:48.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:48.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:48.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:48.484 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:48.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:48.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:48.484 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:48.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:48.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.527438 10287 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.527910 10287 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.528069 10287 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:48.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.532115 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } attempt: 4
23:48:48.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.534868 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.61:36251: Network error: Client connection negotiation failed: client connection to 127.9.248.61:36251: connect: Connection refused (error 111)
23:48:48.536 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:48.536 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:48.537 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:48.537 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:48.537 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:48.537 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:48.537 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:48.537 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:48.537 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:48.537 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:48.537 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:48.537 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:48.537 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:48.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.539767 10287 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:48.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.539921 10287 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:48.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.540014 10287 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:48.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.540087 10287 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:48.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.540180 10287 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:48.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.540285 10287 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40071/jwks.json
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.552814 10287 master_runner.cc:387] Master server non-default flags:
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.61:36251
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40071/jwks.json
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data/info.pb
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.61
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/logs
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:48.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:48.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:48.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:48.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:48.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.555208 10287 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:48.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.557562 10287 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:48.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.567385 10296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:48.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.567397 10295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:48.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.567932 10298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:48.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.569993 10287 server_base.cc:1061] running on GCE node
23:48:48.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.570919 10287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:48.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.572633 10287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:48.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.573933 10287 hybrid_clock.cc:648] HybridClock initialized: now 1783468128573880 us; error 40 us; skew 500 ppm
23:48:48.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.574435 10287 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:48.582 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:48.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.582710 10287 webserver.cc:534] Webserver started at http://127.9.248.61:41867/ using document root <none> and password file <none>
23:48:48.583 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:48.583 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:48.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:48.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:48.583 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:48.583 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:48.583 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:48.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:48.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:48.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:48.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:48.584 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:48.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.584093 10287 fs_manager.cc:362] Metadata directory not provided
23:48:48.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.584256 10287 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:48.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.584728 10287 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:48.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.587733 10287 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data/instance:
23:48:48.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c"
23:48:48.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:48 on dist-test-slave-hfsf"
23:48:48.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.588637 10287 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal/instance:
23:48:48.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c"
23:48:48.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:48 on dist-test-slave-hfsf"
23:48:48.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.595160 10287 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
23:48:48.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.599303 10304 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.601022 10287 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.601224 10287 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c"
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:48 on dist-test-slave-hfsf"
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.601482 10287 fs_report.cc:389] FS layout report
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data/data
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:48.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:48.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:48.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:48.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:48.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:48.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.626121 10287 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:48.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.627192 10287 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:48.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.627537 10287 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:48.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.650779 10287 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.61:36251
23:48:48.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.650791 10355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.61:36251 every 8 connection(s)
23:48:48.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.652693 10287 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/data/info.pb
23:48:48.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.657081 10356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:48.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.658638 10208 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10287
23:48:48.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.658901 10208 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-1/wal/instance
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.660014 10208 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/logs
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data/info.pb
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.60:35483
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.60
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:48.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:48.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:48.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40071/jwks.json with env {}
23:48:48.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.664026 10356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } has no permanent_uuid. Determining permanent_uuid...
23:48:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.680714 10356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } has no permanent_uuid. Determining permanent_uuid...
23:48:48.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.692296 10356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } has no permanent_uuid. Determining permanent_uuid...
23:48:48.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.693639 10306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.695964 10356 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.745294 10356 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 1
23:48:48.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:48.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.747917 10356 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.816184 10356 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 2
23:48:48.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.818539 10356 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.834185 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } attempt: 5
23:48:48.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.845803 10285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } has no permanent_uuid. Determining permanent_uuid...
23:48:48.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.848043 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468128869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:48.881 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:48.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
23:48:48.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.899271 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 1
23:48:48.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.901679 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468128902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:48.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.909821 10356 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 3
23:48:48.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.912422 10356 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.924 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=11 ms).
23:48:48.925 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
23:48:48.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:48.969976 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 2
23:48:48.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:48.972229 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:48.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:49.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.055691 10356 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 4
23:48:49.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.057917 10358 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:49.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.058236 10356 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:49.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.058373 10358 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:49.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.058490 10358 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:49.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.067754 10358 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:48:49.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.067853 10358 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:49.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.067910 10358 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:48:49.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.067974 10358 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:48:49.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.068056 10358 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:48:49.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.068097 10358 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40071/jwks.json
23:48:49.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.078449 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 3
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.079384 10358 master_runner.cc:387] Master server non-default flags:
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:48:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.60:35483
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40071/jwks.json
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data/info.pb
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.60
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/logs
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:49.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.080971 10285 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.60:35483: Network error: Client connection negotiation failed: client connection to 127.9.248.60:35483: connect: Connection refused (error 111)
23:48:49.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.081565 10358 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:49.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.083767 10358 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:49.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.093536 10370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:49.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.093786 10369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:49.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.094386 10372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:49.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.095046 10358 server_base.cc:1061] running on GCE node
23:48:49.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.096028 10358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:49.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.097587 10358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:49.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.098768 10358 hybrid_clock.cc:648] HybridClock initialized: now 1783468129098701 us; error 61 us; skew 500 ppm
23:48:49.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.099220 10358 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:49.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.101686 10358 webserver.cc:534] Webserver started at http://127.9.248.60:45833/ using document root <none> and password file <none>
23:48:49.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.102599 10358 fs_manager.cc:362] Metadata directory not provided
23:48:49.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.102701 10358 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:49.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.103087 10358 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.105798 10358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data/instance:
23:48:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0cdf181a384940568e6c18a17a93b97e"
23:48:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:49 on dist-test-slave-hfsf"
23:48:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.106781 10358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal/instance:
23:48:49.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0cdf181a384940568e6c18a17a93b97e"
23:48:49.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:49 on dist-test-slave-hfsf"
23:48:49.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.113139 10358 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:48:49.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.116878 10378 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:49.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.118491 10358 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.118662 10358 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0cdf181a384940568e6c18a17a93b97e"
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:49 on dist-test-slave-hfsf"
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.118959 10358 fs_report.cc:389] FS layout report
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data/data
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:49.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.141816 10358 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.142779 10358 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.143206 10358 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:49.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.170550 10358 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.60:35483
23:48:49.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.170572 10429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.60:35483 every 8 connection(s)
23:48:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.172632 10358 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/data/info.pb
23:48:49.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.173925 10208 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10358
23:48:49.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.174149 10208 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/master-2/wal/instance
23:48:49.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.184144 10430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:49.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.194121 10430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } has no permanent_uuid. Determining permanent_uuid...
23:48:49.203 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:49.204 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:49.204 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:49.204 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:49.204 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:49.204 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:49.204 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:49.204 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:49.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:49.205 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:49.205 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:49.205 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:49.205 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:49.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.218025 10430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } has no permanent_uuid. Determining permanent_uuid...
23:48:49.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.225103 10430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } has no permanent_uuid. Determining permanent_uuid...
23:48:49.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.236411 10430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: Bootstrap starting.
23:48:49.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.240675 10430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: Neither blocks nor log segments found. Creating new log.
23:48:49.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.241755 10430 log.cc:826] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: Log is configured to *not* fsync() on all Append() calls
23:48:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.244872 10430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: No bootstrap required, opened a new log
23:48:49.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.251300 10430 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.251677 10430 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.251787 10430 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cdf181a384940568e6c18a17a93b97e, State: Initialized, Role: FOLLOWER
23:48:49.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.252381 10430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.253265 10437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.253571 10437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.254540 10430 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: configured and running, proceeding with master startup.
23:48:49.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.258248 10285 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 4
23:48:49.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.272249 10285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: Bootstrap starting.
23:48:49.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.266342 10358 master_runner.cc:187] Error getting master registration for 127.9.248.62:39393: OK, instance_id { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" instance_seqno: 1783468128119794 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:49.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.273061 10358 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:49.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.276623 10285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: Neither blocks nor log segments found. Creating new log.
23:48:49.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.277925 10285 log.cc:826] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: Log is configured to *not* fsync() on all Append() calls
23:48:49.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.279853 10448 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:49.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.280054 10448 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:49.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.281703 10285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: No bootstrap required, opened a new log
23:48:49.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.290338 10285 raft_consensus.cc:359] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.290766 10285 raft_consensus.cc:385] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:49.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.290926 10285 raft_consensus.cc:740] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 923ce0926ecd41c597a7a7d362b7c2ac, State: Initialized, Role: FOLLOWER
23:48:49.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.291867 10285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.293056 10451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.293376 10451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.294516 10285 sys_catalog.cc:565] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: configured and running, proceeding with master startup.
23:48:49.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.320807 10462 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:49.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.321175 10462 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:49.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.318266 10219 master_runner.cc:187] Error getting master registration for 127.9.248.61:36251: OK, instance_id { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" instance_seqno: 1783468128644042 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:48:49.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.325254 10219 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.356666 10239 tablet.cc:2406] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:49.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.357467 10356 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } attempt: 5
23:48:49.369 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468129369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:49.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.372246 10356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: Bootstrap starting.
23:48:49.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.376931 10356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: Neither blocks nor log segments found. Creating new log.
23:48:49.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.378402 10356 log.cc:826] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: Log is configured to *not* fsync() on all Append() calls
23:48:49.390 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
23:48:49.392 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
23:48:49.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.395763 10384 tablet.cc:2406] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:49.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468129402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:49.412 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:49.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
23:48:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.431988 10356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: No bootstrap required, opened a new log
23:48:49.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.441990 10356 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.442371 10356 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:49.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.442493 10356 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3b8bb640ab4b4eb20cfef85b48ea6c, State: Initialized, Role: FOLLOWER
23:48:49.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.443374 10356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.452998 10356 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: configured and running, proceeding with master startup.
23:48:49.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.453693 10465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.454257 10465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.485760 10287 master_runner.cc:264] No leader master found from master 3d3b8bb640ab4b4eb20cfef85b48ea6c
23:48:49.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.485921 10287 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:48:49.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.489892 10476 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:48:49.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.490067 10476 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:48:49.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.517926 10437 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:49.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.518265 10437 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.520305 10437 leader_election.cc:290] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 923ce0926ecd41c597a7a7d362b7c2ac (127.9.248.62:39393), 3d3b8bb640ab4b4eb20cfef85b48ea6c (127.9.248.61:36251)
23:48:49.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.521335 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0cdf181a384940568e6c18a17a93b97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" is_pre_election: true
23:48:49.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.521955 10331 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cdf181a384940568e6c18a17a93b97e in term 0.
23:48:49.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.523425 10380 leader_election.cc:304] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cdf181a384940568e6c18a17a93b97e, 3d3b8bb640ab4b4eb20cfef85b48ea6c; no voters: 
23:48:49.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.523906 10437 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:49.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.524065 10437 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:49.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.524160 10437 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 0 FOLLOWER]: Advancing to term 1
23:48:49.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.524758 10260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0cdf181a384940568e6c18a17a93b97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" is_pre_election: true
23:48:49.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.525280 10260 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cdf181a384940568e6c18a17a93b97e in term 0.
23:48:49.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.527774 10437 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.528620 10437 leader_election.cc:290] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [CANDIDATE]: Term 1 election: Requested vote from peers 923ce0926ecd41c597a7a7d362b7c2ac (127.9.248.62:39393), 3d3b8bb640ab4b4eb20cfef85b48ea6c (127.9.248.61:36251)
23:48:49.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.529775 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0cdf181a384940568e6c18a17a93b97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c"
23:48:49.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.530009 10331 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 0 FOLLOWER]: Advancing to term 1
23:48:49.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.532068 10260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0cdf181a384940568e6c18a17a93b97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "923ce0926ecd41c597a7a7d362b7c2ac"
23:48:49.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.532305 10260 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 0 FOLLOWER]: Advancing to term 1
23:48:49.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.541849 10331 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cdf181a384940568e6c18a17a93b97e in term 1.
23:48:49.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.544961 10380 leader_election.cc:304] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cdf181a384940568e6c18a17a93b97e, 3d3b8bb640ab4b4eb20cfef85b48ea6c; no voters: 
23:48:49.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.545354 10437 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 1 FOLLOWER]: Leader election won for term 1
23:48:49.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.549860 10260 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cdf181a384940568e6c18a17a93b97e in term 1.
23:48:49.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.559275 10437 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [term 1 LEADER]: Becoming Leader. State: Replica: 0cdf181a384940568e6c18a17a93b97e, State: Running, Role: LEADER
23:48:49.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.560240 10437 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } }
23:48:49.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.568724 10478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cdf181a384940568e6c18a17a93b97e. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.569456 10478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: This master's current role is: LEADER
23:48:49.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.583487 10480 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:48:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.586189 10480 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:48:49.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.596712 10331 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [term 1 FOLLOWER]: Refusing update from remote peer 0cdf181a384940568e6c18a17a93b97e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:49.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.598269 10478 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:49.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.610270 10260 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [term 1 FOLLOWER]: Refusing update from remote peer 0cdf181a384940568e6c18a17a93b97e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:48:49.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.611547 10478 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:49.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:49.630525 10310 tablet.cc:2406] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:49.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.632580 10451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cdf181a384940568e6c18a17a93b97e. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.632867 10451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.638412 10483 mvcc.cc:204] Tried to move back new op lower bound from 7305085458814476288 to 7305085458685878272. Current Snapshot: MvccSnapshot[applied={T|T < 7305085458814476288}]
23:48:49.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.638756 10481 mvcc.cc:204] Tried to move back new op lower bound from 7305085458814476288 to 7305085458685878272. Current Snapshot: MvccSnapshot[applied={T|T < 7305085458814476288}]
23:48:49.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.653067 10437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.653398 10437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: This master's current role is: LEADER
23:48:49.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.653434 10451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.653638 10451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.661660 10480 catalog_manager.cc:1382] Generated new cluster ID: 1d56640d7006429b88b1fc7d54033c07
23:48:49.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.661788 10480 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:48:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.668994 10465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cdf181a384940568e6c18a17a93b97e. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.669265 10465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.673368 10478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.673629 10478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e [sys.catalog]: This master's current role is: LEADER
23:48:49.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.677798 10482 mvcc.cc:204] Tried to move back new op lower bound from 7305085458814476288 to 7305085458685878272. Current Snapshot: MvccSnapshot[applied={T|T < 7305085458814476288}]
23:48:49.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.679008 10480 catalog_manager.cc:1405] Generated new certificate authority record
23:48:49.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.683094 10480 catalog_manager.cc:1539] Loading token signing keys...
23:48:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.693456 10465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0cdf181a384940568e6c18a17a93b97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "923ce0926ecd41c597a7a7d362b7c2ac" member_type: VOTER last_known_addr { host: "127.9.248.62" port: 39393 } } peers { permanent_uuid: "3d3b8bb640ab4b4eb20cfef85b48ea6c" member_type: VOTER last_known_addr { host: "127.9.248.61" port: 36251 } } peers { permanent_uuid: "0cdf181a384940568e6c18a17a93b97e" member_type: VOTER last_known_addr { host: "127.9.248.60" port: 35483 } } }
23:48:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.693727 10465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c [sys.catalog]: This master's current role is: FOLLOWER
23:48:49.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.720364 10480 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: Generated new TSK 0
23:48:49.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.721575 10480 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:48:49.739 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:49.739 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:49.739 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:49.739 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:49.739 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:49.740 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:49.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:49.738000 10208 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:49.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:49.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/logs
23:48:49.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data/info.pb
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.1:0
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.1
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.1
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:49.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:49.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:49.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:49.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:49.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:49.741 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:49.741 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:49.741 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:49.741 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:49.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:49.844 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:49.845 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:49.845 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:49.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:49.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:49.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:49.846 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:49.846 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:49.846 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:49.846 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:49.847 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:49.847 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:49.847 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:49.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468129869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:49.886 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:48:49.888 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
23:48:49.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468129902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:49.913 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:49.914 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
23:48:49.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:50.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:50.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.262327 10490 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:50.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.262648 10490 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:50.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.262730 10490 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:50.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.271848 10490 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:50.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.272033 10490 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.248.1
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.283329 10490 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.1:0
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data/info.pb
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.1
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.1
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/logs
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:50.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:50.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.285133 10490 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:50.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.287267 10490 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:50.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.298883 10497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:50.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.298884 10496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:50.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.299502 10499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:50.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.300376 10490 server_base.cc:1061] running on GCE node
23:48:50.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.301064 10490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:50.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.302186 10490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:50.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.303400 10490 hybrid_clock.cc:648] HybridClock initialized: now 1783468130303337 us; error 50 us; skew 500 ppm
23:48:50.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.303740 10490 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:50.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.306455 10490 webserver.cc:534] Webserver started at http://127.9.248.1:45717/ using document root <none> and password file <none>
23:48:50.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.307514 10490 fs_manager.cc:362] Metadata directory not provided
23:48:50.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.307621 10490 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:50.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.308053 10490 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:50.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.311115 10490 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data/instance:
23:48:50.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "783d9938b0e042a59f828e194dbbd5fc"
23:48:50.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:50 on dist-test-slave-hfsf"
23:48:50.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.312039 10490 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal/instance:
23:48:50.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "783d9938b0e042a59f828e194dbbd5fc"
23:48:50.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:50 on dist-test-slave-hfsf"
23:48:50.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.318733 10490 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:48:50.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.322868 10505 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:50.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.323813 10462 catalog_manager.cc:1294] Loaded cluster ID: 1d56640d7006429b88b1fc7d54033c07
23:48:50.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.323917 10462 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: loading cluster ID for follower catalog manager: success
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.324851 10490 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.325080 10490 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "783d9938b0e042a59f828e194dbbd5fc"
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:50 on dist-test-slave-hfsf"
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.325348 10490 fs_report.cc:389] FS layout report
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data/data
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:50.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:50.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.328262 10462 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: acquiring CA information for follower catalog manager: success
23:48:50.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.331051 10462 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 923ce0926ecd41c597a7a7d362b7c2ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.356371 10490 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.357401 10490 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.357681 10490 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:50.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.359462 10490 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.361442 10490 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.361588 10490 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.361711 10490 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.361817 10490 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:50.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468130369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:50.380 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:50.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
23:48:50.404 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468130402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:50.415 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:48:50.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
23:48:50.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.439656 10490 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.1:35283
23:48:50.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.439697 10617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.1:35283 every 8 connection(s)
23:48:50.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.441342 10490 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/data/info.pb
23:48:50.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.451382 10208 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10490
23:48:50.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.451679 10208 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-0/wal/instance
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.457940 10208 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/logs
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data/info.pb
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.2:0
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.2
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.2
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:50.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.470135 10618 heartbeater.cc:344] Connected to a master server at 127.9.248.60:35483
23:48:50.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.470495 10618 heartbeater.cc:461] Registering TS with master...
23:48:50.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.471526 10618 heartbeater.cc:507] Master 127.9.248.60:35483 requested a full tablet report, sending...
23:48:50.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.475572 10395 ts_manager.cc:194] Registered new tserver with Master: 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283)
23:48:50.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.477628 10395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.248.1:48179
23:48:50.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:50.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.486151 10619 heartbeater.cc:344] Connected to a master server at 127.9.248.62:39393
23:48:50.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.486320 10619 heartbeater.cc:461] Registering TS with master...
23:48:50.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.486706 10619 heartbeater.cc:507] Master 127.9.248.62:39393 requested a full tablet report, sending...
23:48:50.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.488867 10250 ts_manager.cc:194] Registered new tserver with Master: 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283)
23:48:50.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.492167 10476 catalog_manager.cc:1294] Loaded cluster ID: 1d56640d7006429b88b1fc7d54033c07
23:48:50.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.492306 10476 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: loading cluster ID for follower catalog manager: success
23:48:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.496137 10476 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: acquiring CA information for follower catalog manager: success
23:48:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.498679 10476 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 3d3b8bb640ab4b4eb20cfef85b48ea6c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:48:50.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.499150 10620 heartbeater.cc:344] Connected to a master server at 127.9.248.61:36251
23:48:50.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.499372 10620 heartbeater.cc:461] Registering TS with master...
23:48:50.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.499759 10620 heartbeater.cc:507] Master 127.9.248.61:36251 requested a full tablet report, sending...
23:48:50.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.501833 10321 ts_manager.cc:194] Registered new tserver with Master: 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283)
23:48:50.747 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:50.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.843685 10625 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:50.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.844012 10625 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:50.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.844095 10625 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:50.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.852715 10625 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:50.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.852890 10625 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.248.2
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.864039 10625 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.2:0
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data/info.pb
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.2
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.2
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/logs
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:50.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:50.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.865893 10625 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:50.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.868250 10625 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:50.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468130869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:50.878 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:50.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
23:48:50.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.881722 10632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:50.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.881961 10633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:50.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:50.884133 10635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:50.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.884734 10625 server_base.cc:1061] running on GCE node
23:48:50.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.885471 10625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:50.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.886619 10625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:50.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.887953 10625 hybrid_clock.cc:648] HybridClock initialized: now 1783468130887849 us; error 51 us; skew 500 ppm
23:48:50.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.888301 10625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:50.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.890969 10625 webserver.cc:534] Webserver started at http://127.9.248.2:44447/ using document root <none> and password file <none>
23:48:50.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.891904 10625 fs_manager.cc:362] Metadata directory not provided
23:48:50.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.892056 10625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:50.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.892382 10625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:50.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.895289 10625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data/instance:
23:48:50.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0bbd3b7684d64d54bae378c85bb641f3"
23:48:50.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:50 on dist-test-slave-hfsf"
23:48:50.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.896348 10625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal/instance:
23:48:50.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0bbd3b7684d64d54bae378c85bb641f3"
23:48:50.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:50 on dist-test-slave-hfsf"
23:48:50.902 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:50.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.903069 10625 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
23:48:50.903 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:50.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468130902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:50.903 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:50.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:50.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:50.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:50.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:50.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:50.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:50.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:50.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:50.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:50.905 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:50.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.908582 10641 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:50.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.910347 10625 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
23:48:50.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.910548 10625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal
23:48:50.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0bbd3b7684d64d54bae378c85bb641f3"
23:48:50.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:50 on dist-test-slave-hfsf"
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.910778 10625 fs_report.cc:389] FS layout report
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data/data
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:50.911 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:50.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
23:48:50.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.929092 10625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:50.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.930199 10625 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:50.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.930544 10625 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:50.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.931809 10625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:50.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.933725 10625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:50.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.933845 10625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:50.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.933933 10625 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:50.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.934008 10625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:50.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.972280 10625 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.2:38803
23:48:50.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.972311 10753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.2:38803 every 8 connection(s)
23:48:50.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.973834 10625 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/data/info.pb
23:48:50.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.979526 10208 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10625
23:48:50.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.979723 10208 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-1/wal/instance
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.983919 10208 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/logs
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data/info.pb
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:50.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.3:0
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.3
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.3
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:50.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:48:50.987 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:50.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.993939 10755 heartbeater.cc:344] Connected to a master server at 127.9.248.62:39393
23:48:50.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.994087 10754 heartbeater.cc:344] Connected to a master server at 127.9.248.60:35483
23:48:50.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.994119 10756 heartbeater.cc:344] Connected to a master server at 127.9.248.61:36251
23:48:50.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.994535 10754 heartbeater.cc:461] Registering TS with master...
23:48:50.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.994532 10755 heartbeater.cc:461] Registering TS with master...
23:48:50.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.994536 10756 heartbeater.cc:461] Registering TS with master...
23:48:50.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.996073 10754 heartbeater.cc:507] Master 127.9.248.60:35483 requested a full tablet report, sending...
23:48:50.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.996093 10756 heartbeater.cc:507] Master 127.9.248.61:36251 requested a full tablet report, sending...
23:48:50.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.996533 10755 heartbeater.cc:507] Master 127.9.248.62:39393 requested a full tablet report, sending...
23:48:50.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.998176 10395 ts_manager.cc:194] Registered new tserver with Master: 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803)
23:48:50.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.998342 10250 ts_manager.cc:194] Registered new tserver with Master: 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803)
23:48:50.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.999168 10321 ts_manager.cc:194] Registered new tserver with Master: 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803)
23:48:50.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:50.999358 10395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.248.2:53425
23:48:51.096 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:51.096 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:51.096 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:51.096 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.096 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.096 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.096 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.097 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.097 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.097 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:51.127 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:51.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:51.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:51.128 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.128 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.128 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.129 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.129 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.129 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.129 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.129 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.129 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.129 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:51.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:51.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468131369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:51.378 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:51.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
23:48:51.384 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:51.384 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:51.384 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:51.384 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.385 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.385 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:51.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.384 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:51.385 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.385 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:51.385 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:51.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.387508 10762 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:48:51.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.387850 10762 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:48:51.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.387946 10762 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:48:51.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.398921 10762 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:48:51.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.399114 10762 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.248.3
23:48:51.402 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468131402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:51.411 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:51.412 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.413954 10762 tablet_server_runner.cc:78] Tablet server non-default flags:
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.20:37003
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.3:0
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data/info.pb
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.3
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.62:39393,127.9.248.61:36251,127.9.248.60:35483
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.3
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/logs
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:48:51.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:48:51.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.415989 10762 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:48:51.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.418179 10762 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:48:51.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.430312 10770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:51.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.430239 10767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:51.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.430182 10768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:48:51.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.432019 10762 server_base.cc:1061] running on GCE node
23:48:51.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.432757 10762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:48:51.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.433952 10762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:48:51.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.435209 10762 hybrid_clock.cc:648] HybridClock initialized: now 1783468131435143 us; error 39 us; skew 500 ppm
23:48:51.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.435600 10762 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:48:51.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.438582 10762 webserver.cc:534] Webserver started at http://127.9.248.3:44041/ using document root <none> and password file <none>
23:48:51.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.439777 10762 fs_manager.cc:362] Metadata directory not provided
23:48:51.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.439945 10762 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:48:51.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.440333 10762 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:48:51.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.443367 10762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data/instance:
23:48:51.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a147bd31ba747b29bca1dbfb99edafa"
23:48:51.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:51 on dist-test-slave-hfsf"
23:48:51.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.444350 10762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal/instance:
23:48:51.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a147bd31ba747b29bca1dbfb99edafa"
23:48:51.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:51 on dist-test-slave-hfsf"
23:48:51.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.451139 10762 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
23:48:51.456 [DEBUG - pool-92-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.5.195.124:40929, [2ms] received response from server master-127.5.195.124:40929: OK, deferred=null) with no deferred attached!
23:48:51.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.455941 10776 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:48:51.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.457665 10762 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.457947 10762 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a147bd31ba747b29bca1dbfb99edafa"
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:48:51 on dist-test-slave-hfsf"
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.458326 10762 fs_report.cc:389] FS layout report
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data/data
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:48:51.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:48:51.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.481793 10618 heartbeater.cc:499] Master 127.9.248.60:35483 was elected leader, sending a full tablet report...
23:48:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.483790 10762 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:48:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.484962 10762 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:48:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.485236 10762 kserver.cc:163] Server-wide thread pool size limit: 3276
23:48:51.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:51.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.486653 10762 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:48:51.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.488847 10762 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:48:51.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.488963 10762 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:48:51.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.489086 10762 ts_tablet_manager.cc:616] Registered 0 tablets
23:48:51.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.489168 10762 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:48:51.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.536837 10762 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.3:36277
23:48:51.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.536882 10888 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.3:36277 every 8 connection(s)
23:48:51.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.538460 10762 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/data/info.pb
23:48:51.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.544620 10208 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 10762
23:48:51.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.544811 10208 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster8029977661122674783/ts-2/wal/instance
23:48:51.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.559156 10889 heartbeater.cc:344] Connected to a master server at 127.9.248.60:35483
23:48:51.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.559624 10889 heartbeater.cc:461] Registering TS with master...
23:48:51.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.560046 10890 heartbeater.cc:344] Connected to a master server at 127.9.248.62:39393
23:48:51.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.560218 10890 heartbeater.cc:461] Registering TS with master...
23:48:51.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.560876 10891 heartbeater.cc:344] Connected to a master server at 127.9.248.61:36251
23:48:51.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.561067 10890 heartbeater.cc:507] Master 127.9.248.62:39393 requested a full tablet report, sending...
23:48:51.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.561117 10891 heartbeater.cc:461] Registering TS with master...
23:48:51.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.561117 10889 heartbeater.cc:507] Master 127.9.248.60:35483 requested a full tablet report, sending...
23:48:51.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.561728 10891 heartbeater.cc:507] Master 127.9.248.61:36251 requested a full tablet report, sending...
23:48:51.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.563119 10321 ts_manager.cc:194] Registered new tserver with Master: 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:51.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.563150 10395 ts_manager.cc:194] Registered new tserver with Master: 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:51.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.563265 10250 ts_manager.cc:194] Registered new tserver with Master: 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:51.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.564275 10395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.248.3:58397
23:48:51.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.573630 10208 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:48:51.576 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:48:51.576 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:48:51.577 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.248.62"
      port: 39393
    }
    bound_http_address {
      host: "127.9.248.62"
      port: 35899
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.248.61"
      port: 36251
    }
    bound_http_address {
      host: "127.9.248.61"
      port: 41867
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.248.60"
      port: 35483
    }
    bound_http_address {
      host: "127.9.248.60"
      port: 45833
    }
  }
}

23:48:51.578 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:48:51.579 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.248.1"
      port: 35283
    }
    bound_http_address {
      host: "127.9.248.1"
      port: 45717
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.248.2"
      port: 38803
    }
    bound_http_address {
      host: "127.9.248.2"
      port: 44447
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.248.3"
      port: 36277
    }
    bound_http_address {
      host: "127.9.248.3"
      port: 44041
    }
  }
}

23:48:51.579 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:48:51.581 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:51.582 [DEBUG - main] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:48:51.583 [DEBUG - main] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:51.584 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.73.188:35043(127.9.73.188:35043)] Successfully connected to peer
23:48:51.584 [DEBUG - main] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:51.587 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.188
23:48:51.587 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.73.190:40177(127.9.73.190:40177)] Successfully connected to peer
23:48:51.591 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.73.189:33103(127.9.73.189:33103)] Successfully connected to peer
23:48:51.594 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.189
23:48:51.596 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.190
23:48:51.599 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:51.603 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd61599df, L:/127.0.0.1:57266 - R:/127.9.73.188:35043] using SASL/PLAIN
23:48:51.606 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:51.609 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:51.611 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x15fb9b18, L:/127.0.0.1:56756 - R:/127.9.73.190:40177] using SASL/PLAIN
23:48:51.612 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x95f43a19, L:/127.0.0.1:33104 - R:/127.9.73.189:33103] using SASL/PLAIN
23:48:51.614 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:51.614 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [23ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: OK, deferred=null) after lookup
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.616098  9557 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56756:
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\001d\000\000\000\004\001\310\000\000\000"
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:51.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.618605  9557 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:51.643 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:51.643 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:51.644 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:51.644 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:51.644 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:51.644 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:51.644 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:51.644 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:51.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:51.645 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:51.645 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:51.645 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:51.645 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:51.647 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29687), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [5ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [25ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [59ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [59ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [99ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [105ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [105ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [123ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [202ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [202ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [203ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [203ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [343ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [344ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [345ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [345ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [385ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [386ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [387ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [387ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [622ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [623ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [623ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [624ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1660ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [1662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1663ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [3563ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [4481ms] refreshing cache from master, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [4482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4482ms] too many traces: truncated at 100 traces, deferred=Deferred@2045566780(state=PENDING, result=null, callback=(continuation of Deferred@1170889725 after retry RPC after error@1006041101) -> (continuation of Deferred@2000412000 after retry RPC after error@1748101508) -> (continuation of Deferred@2134069964 after retry RPC after error@1938418615) -> (continuation of Deferred@1517348987 after retry RPC after error@1030379384) -> (continuation of Deferred@1487587115 after retry RPC after error@1682066394) -> (continuation of Deferred@967590937 after retry RPC after error@1444025795) -> (continuation of Deferred@1485767605 after retry RPC after error@786800613) -> (continuation of Deferred@1974635180 after retry RPC after error@860370388) -> (continuation of Deferred@326765219 after retry RPC after error@300070302) -> (continuation of Deferred@1894038244 after retry RPC after error@40949689) -> (continuation of Deferred@1092418118 after retry RPC after error@1163323838) -> (continuation of Deferred@279992426 after retry RPC after error@343509210) -> (continuation of Deferred@848400089 after retry RPC after error@1090030124) -> (continuation of Deferred@1377433937 after retry RPC after error@184452240) -> (continuation of Deferred@883369040 after retry RPC after error@814379266) -> (continuation of Deferred@759485747 after retry RPC after error@1398803983) -> (continuation of Deferred@1583887767 after retry RPC after error@1024023865) -> (continuation of Deferred@921696998 after retry RPC after error@1697421890) -> (continuation of Deferred@2063060989 after retry RPC after error@224437519) -> (continuation of Deferred@1141982863 after retry RPC after error@1164847813) -> (continuation of Deferred@27430322 after retry RPC after error@157423700) -> (continuation of Deferred@1191776969 after retry RPC after error@1929720047) -> (continuation of Deferred@1725955104 after retry RPC after error@2145843223) -> (continuation of Deferred@1895182968 after retry RPC after error@716105409), errback=(continuation of Deferred@1170889725 after retry RPC after error@1006041101) -> (continuation of Deferred@2000412000 after retry RPC after error@1748101508) -> (continuation of Deferred@2134069964 after retry RPC after error@1938418615) -> (continuation of Deferred@1517348987 after retry RPC after error@1030379384) -> (continuation of Deferred@1487587115 after retry RPC after error@1682066394) -> (continuation of Deferred@967590937 after retry RPC after error@1444025795) -> (continuation of Deferred@1485767605 after retry RPC after error@786800613) -> (continuation of Deferred@1974635180 after retry RPC after error@860370388) -> (continuation of Deferred@326765219 after retry RPC after error@300070302) -> (continuation of Deferred@1894038244 after retry RPC after error@40949689) -> (continuation of Deferred@1092418118 after retry RPC after error@1163323838) -> (continuation of Deferred@279992426 after retry RPC after error@343509210) -> (continuation of Deferred@848400089 after retry RPC after error@1090030124) -> (continuation of Deferred@1377433937 after retry RPC after error@184452240) -> (continuation of Deferred@883369040 after retry RPC after error@814379266) -> (continuation of Deferred@759485747 after retry RPC after error@1398803983) -> (continuation of Deferred@1583887767 after retry RPC after error@1024023865) -> (continuation of Deferred@921696998 after retry RPC after error@1697421890) -> (continuation of Deferred@2063060989 after retry RPC after error@224437519) -> (continuation of Deferred@1141982863 after retry RPC after error@1164847813) -> (continuation of Deferred@27430322 after retry RPC after error@157423700) -> (continuation of Deferred@1191776969 after retry RPC after error@1929720047) -> (continuation of Deferred@1725955104 after retry RPC after error@2145843223) -> (continuation of Deferred@1895182968 after retry RPC after error@716105409)))
23:48:51.648 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:48:51.648 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29687), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [5ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [25ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [59ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [59ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [99ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [105ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [105ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [123ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [202ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [202ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [203ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [203ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [343ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [344ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [345ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [345ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [385ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [386ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [387ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [387ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [622ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [623ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [623ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [624ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1660ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [1662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1663ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [3563ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [4481ms] refreshing cache from master, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [4482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4482ms] too many traces: truncated at 100 traces, deferred=Deferred@2045566780(state=PENDING, result=null, callback=(continuation of Deferred@1170889725 after retry RPC after error@1006041101) -> (continuation of Deferred@2000412000 after retry RPC after error@1748101508) -> (continuation of Deferred@2134069964 after retry RPC after error@1938418615) -> (continuation of Deferred@1517348987 after retry RPC after error@1030379384) -> (continuation of Deferred@1487587115 after retry RPC after error@1682066394) -> (continuation of Deferred@967590937 after retry RPC after error@1444025795) -> (continuation of Deferred@1485767605 after retry RPC after error@786800613) -> (continuation of Deferred@1974635180 after retry RPC after error@860370388) -> (continuation of Deferred@326765219 after retry RPC after error@300070302) -> (continuation of Deferred@1894038244 after retry RPC after error@40949689) -> (continuation of Deferred@1092418118 after retry RPC after error@1163323838) -> (continuation of Deferred@279992426 after retry RPC after error@343509210) -> (continuation of Deferred@848400089 after retry RPC after error@1090030124) -> (continuation of Deferred@1377433937 after retry RPC after error@184452240) -> (continuation of Deferred@883369040 after retry RPC after error@814379266) -> (continuation of Deferred@759485747 after retry RPC after error@1398803983) -> (continuation of Deferred@1583887767 after retry RPC after error@1024023865) -> (continuation of Deferred@921696998 after retry RPC after error@1697421890) -> (continuation of Deferred@2063060989 after retry RPC after error@224437519) -> (continuation of Deferred@1141982863 after retry RPC after error@1164847813) -> (continuation of Deferred@27430322 after retry RPC after error@157423700) -> (continuation of Deferred@1191776969 after retry RPC after error@1929720047) -> (continuation of Deferred@1725955104 after retry RPC after error@2145843223) -> (continuation of Deferred@1895182968 after retry RPC after error@716105409), errback=(continuation of Deferred@1170889725 after retry RPC after error@1006041101) -> (continuation of Deferred@2000412000 after retry RPC after error@1748101508) -> (continuation of Deferred@2134069964 after retry RPC after error@1938418615) -> (continuation of Deferred@1517348987 after retry RPC after error@1030379384) -> (continuation of Deferred@1487587115 after retry RPC after error@1682066394) -> (continuation of Deferred@967590937 after retry RPC after error@1444025795) -> (continuation of Deferred@1485767605 after retry RPC after error@786800613) -> (continuation of Deferred@1974635180 after retry RPC after error@860370388) -> (continuation of Deferred@326765219 after retry RPC after error@300070302) -> (continuation of Deferred@1894038244 after retry RPC after error@40949689) -> (continuation of Deferred@1092418118 after retry RPC after error@1163323838) -> (continuation of Deferred@279992426 after retry RPC after error@343509210) -> (continuation of Deferred@848400089 after retry RPC after error@1090030124) -> (continuation of Deferred@1377433937 after retry RPC after error@184452240) -> (continuation of Deferred@883369040 after retry RPC after error@814379266) -> (continuation of Deferred@759485747 after retry RPC after error@1398803983) -> (continuation of Deferred@1583887767 after retry RPC after error@1024023865) -> (continuation of Deferred@921696998 after retry RPC after error@1697421890) -> (continuation of Deferred@2063060989 after retry RPC after error@224437519) -> (continuation of Deferred@1141982863 after retry RPC after error@1164847813) -> (continuation of Deferred@27430322 after retry RPC after error@157423700) -> (continuation of Deferred@1191776969 after retry RPC after error@1929720047) -> (continuation of Deferred@1725955104 after retry RPC after error@2145843223) -> (continuation of Deferred@1895182968 after retry RPC after error@716105409)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.216.124:33041
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:51.649 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
23:48:51.652 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
23:48:51.655 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29687), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [5ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [25ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [59ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [59ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [99ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [105ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [105ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [123ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [202ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [202ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [203ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [203ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [343ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [344ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [345ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [345ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [385ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [386ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [387ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [387ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [622ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [623ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [623ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [624ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1660ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [1662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1663ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [3563ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [4481ms] refreshing cache from master, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [4482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4482ms] too many traces: truncated at 100 traces, deferred=Deferred@2045566780(state=PENDING, result=null, callback=(continuation of Deferred@1170889725 after retry RPC after error@1006041101) -> (continuation of Deferred@2000412000 after retry RPC after error@1748101508) -> (continuation of Deferred@2134069964 after retry RPC after error@1938418615) -> (continuation of Deferred@1517348987 after retry RPC after error@1030379384) -> (continuation of Deferred@1487587115 after retry RPC after error@1682066394) -> (continuation of Deferred@967590937 after retry RPC after error@1444025795) -> (continuation of Deferred@1485767605 after retry RPC after error@786800613) -> (continuation of Deferred@1974635180 after retry RPC after error@860370388) -> (continuation of Deferred@326765219 after retry RPC after error@300070302) -> (continuation of Deferred@1894038244 after retry RPC after error@40949689) -> (continuation of Deferred@1092418118 after retry RPC after error@1163323838) -> (continuation of Deferred@279992426 after retry RPC after error@343509210) -> (continuation of Deferred@848400089 after retry RPC after error@1090030124) -> (continuation of Deferred@1377433937 after retry RPC after error@184452240) -> (continuation of Deferred@883369040 after retry RPC after error@814379266) -> (continuation of Deferred@759485747 after retry RPC after error@1398803983) -> (continuation of Deferred@1583887767 after retry RPC after error@1024023865) -> (continuation of Deferred@921696998 after retry RPC after error@1697421890) -> (continuation of Deferred@2063060989 after retry RPC after error@224437519) -> (continuation of Deferred@1141982863 after retry RPC after error@1164847813) -> (continuation of Deferred@27430322 after retry RPC after error@157423700) -> (continuation of Deferred@1191776969 after retry RPC after error@1929720047) -> (continuation of Deferred@1725955104 after retry RPC after error@2145843223) -> (continuation of Deferred@1895182968 after retry RPC after error@716105409), errback=(continuation of Deferred@1170889725 after retry RPC after error@1006041101) -> (continuation of Deferred@2000412000 after retry RPC after error@1748101508) -> (continuation of Deferred@2134069964 after retry RPC after error@1938418615) -> (continuation of Deferred@1517348987 after retry RPC after error@1030379384) -> (continuation of Deferred@1487587115 after retry RPC after error@1682066394) -> (continuation of Deferred@967590937 after retry RPC after error@1444025795) -> (continuation of Deferred@1485767605 after retry RPC after error@786800613) -> (continuation of Deferred@1974635180 after retry RPC after error@860370388) -> (continuation of Deferred@326765219 after retry RPC after error@300070302) -> (continuation of Deferred@1894038244 after retry RPC after error@40949689) -> (continuation of Deferred@1092418118 after retry RPC after error@1163323838) -> (continuation of Deferred@279992426 after retry RPC after error@343509210) -> (continuation of Deferred@848400089 after retry RPC after error@1090030124) -> (continuation of Deferred@1377433937 after retry RPC after error@184452240) -> (continuation of Deferred@883369040 after retry RPC after error@814379266) -> (continuation of Deferred@759485747 after retry RPC after error@1398803983) -> (continuation of Deferred@1583887767 after retry RPC after error@1024023865) -> (continuation of Deferred@921696998 after retry RPC after error@1697421890) -> (continuation of Deferred@2063060989 after retry RPC after error@224437519) -> (continuation of Deferred@1141982863 after retry RPC after error@1164847813) -> (continuation of Deferred@27430322 after retry RPC after error@157423700) -> (continuation of Deferred@1191776969 after retry RPC after error@1929720047) -> (continuation of Deferred@1725955104 after retry RPC after error@2145843223) -> (continuation of Deferred@1895182968 after retry RPC after error@716105409)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.216.124:33041
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:51.656 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:51.656 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
23:48:51.656 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
23:48:51.656 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state RUNNING to RESTARTING.
23:48:51.663 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:51.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.713733 10131 tablet_service.cc:1511] Processing CreateTablet for tablet d946712f74c14c10a3a819b2b5fbdea4 (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION 200 <= VALUES
23:48:51.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.715775 10133 tablet_service.cc:1511] Processing CreateTablet for tablet 14a063200fb74afa9665736f005dd7fe (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION VALUES < 100
23:48:51.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.714723 10132 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf762a7433f4690bd8243d3ae223cfe (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:51.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.717082 10132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf762a7433f4690bd8243d3ae223cfe. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.718416 10133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a063200fb74afa9665736f005dd7fe. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.718745 10131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d946712f74c14c10a3a819b2b5fbdea4. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.725200  9859 tablet_service.cc:1511] Processing CreateTablet for tablet 14a063200fb74afa9665736f005dd7fe (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION VALUES < 100
23:48:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.727473  9859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a063200fb74afa9665736f005dd7fe. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.730510  9858 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf762a7433f4690bd8243d3ae223cfe (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:51.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.731359  9858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf762a7433f4690bd8243d3ae223cfe. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.732162  9857 tablet_service.cc:1511] Processing CreateTablet for tablet d946712f74c14c10a3a819b2b5fbdea4 (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION 200 <= VALUES
23:48:51.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.732663  9857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d946712f74c14c10a3a819b2b5fbdea4. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.726411  9996 tablet_service.cc:1511] Processing CreateTablet for tablet 14a063200fb74afa9665736f005dd7fe (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION VALUES < 100
23:48:51.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.736750  9996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a063200fb74afa9665736f005dd7fe. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.739 [DEBUG - pool-95-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.6.114.124:34801, [3ms] received response from server master-127.6.114.124:34801: OK, deferred=null) with no deferred attached!
23:48:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.740365  9994 tablet_service.cc:1511] Processing CreateTablet for tablet d946712f74c14c10a3a819b2b5fbdea4 (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION 200 <= VALUES
23:48:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.740897  9995 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf762a7433f4690bd8243d3ae223cfe (DEFAULT_TABLE table=replication_test_table [id=0035761b248d44d99ca5e674f4a71d23]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.741411  9994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d946712f74c14c10a3a819b2b5fbdea4. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.747234  9995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf762a7433f4690bd8243d3ae223cfe. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:51.764 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:51.764 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:51.765 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:51.765 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:51.765 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:51.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:51.765 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:51.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:51.765 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:51.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.765904 10923 tablet_bootstrap.cc:492] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: Bootstrap starting.
23:48:51.766 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:51.766 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:51.766 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:51.766 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:51.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.770855 10923 tablet_bootstrap.cc:654] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: Neither blocks nor log segments found. Creating new log.
23:48:51.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.773721 10923 log.cc:826] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: Log is configured to *not* fsync() on all Append() calls
23:48:51.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.787874 10925 tablet_bootstrap.cc:492] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967: Bootstrap starting.
23:48:51.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.789291 10923 tablet_bootstrap.cc:492] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: No bootstrap required, opened a new log
23:48:51.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.789546 10922 tablet_bootstrap.cc:492] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf: Bootstrap starting.
23:48:51.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.789929 10923 ts_tablet_manager.cc:1403] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
23:48:51.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.796453 10922 tablet_bootstrap.cc:654] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf: Neither blocks nor log segments found. Creating new log.
23:48:51.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.799129 10922 log.cc:826] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf: Log is configured to *not* fsync() on all Append() calls
23:48:51.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.799566 10923 raft_consensus.cc:359] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.800199 10923 raft_consensus.cc:385] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.800412 10923 raft_consensus.cc:740] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42ee4c8ed30413397629819d068081b, State: Initialized, Role: FOLLOWER
23:48:51.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.800611 10925 tablet_bootstrap.cc:654] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967: Neither blocks nor log segments found. Creating new log.
23:48:51.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.801402 10923 consensus_queue.cc:260] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.803817 10925 log.cc:826] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967: Log is configured to *not* fsync() on all Append() calls
23:48:51.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.807610 10923 ts_tablet_manager.cc:1434] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.007s
23:48:51.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.808730  9927 tablet.cc:2406] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:51.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.809612 10922 tablet_bootstrap.cc:492] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf: No bootstrap required, opened a new log
23:48:51.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.809959 10922 ts_tablet_manager.cc:1403] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
23:48:51.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.811934 10923 tablet_bootstrap.cc:492] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b: Bootstrap starting.
23:48:51.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.814524 10923 tablet_bootstrap.cc:654] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b: Neither blocks nor log segments found. Creating new log.
23:48:51.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.817914 10925 tablet_bootstrap.cc:492] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967: No bootstrap required, opened a new log
23:48:51.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.818292 10925 ts_tablet_manager.cc:1403] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.006s
23:48:51.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.823447 10922 raft_consensus.cc:359] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.823871 10922 raft_consensus.cc:385] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.823992 10922 raft_consensus.cc:740] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a06e574087eb4f62863affbc0d2d5eaf, State: Initialized, Role: FOLLOWER
23:48:51.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.824838 10922 consensus_queue.cc:260] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.825016 10925 raft_consensus.cc:359] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.825613 10925 raft_consensus.cc:385] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.825836 10925 raft_consensus.cc:740] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ab6d3c9b044d9c88d6a81463114967, State: Initialized, Role: FOLLOWER
23:48:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.826740 10925 consensus_queue.cc:260] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.828135 10922 ts_tablet_manager.cc:1434] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.001s
23:48:51.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.828630 10922 tablet_bootstrap.cc:492] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf: Bootstrap starting.
23:48:51.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.830830 10922 tablet_bootstrap.cc:654] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf: Neither blocks nor log segments found. Creating new log.
23:48:51.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.836329 10925 ts_tablet_manager.cc:1434] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967: Time spent starting tablet: real 0.017s	user 0.017s	sys 0.001s
23:48:51.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.837034 10925 tablet_bootstrap.cc:492] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967: Bootstrap starting.
23:48:51.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.839226 10925 tablet_bootstrap.cc:654] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967: Neither blocks nor log segments found. Creating new log.
23:48:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.840981 10922 tablet_bootstrap.cc:492] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf: No bootstrap required, opened a new log
23:48:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.841830 10922 ts_tablet_manager.cc:1403] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.006s
23:48:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.844631 10922 raft_consensus.cc:359] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.844920 10922 raft_consensus.cc:385] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.845016 10922 raft_consensus.cc:740] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a06e574087eb4f62863affbc0d2d5eaf, State: Initialized, Role: FOLLOWER
23:48:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.845399 10922 consensus_queue.cc:260] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.845566 10923 tablet_bootstrap.cc:492] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b: No bootstrap required, opened a new log
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.845768 10923 ts_tablet_manager.cc:1403] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.846905 10923 raft_consensus.cc:359] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.847095 10923 raft_consensus.cc:385] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.847185 10923 raft_consensus.cc:740] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42ee4c8ed30413397629819d068081b, State: Initialized, Role: FOLLOWER
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.847203 10922 ts_tablet_manager.cc:1434] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.847429 10923 consensus_queue.cc:260] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.848555 10922 tablet_bootstrap.cc:492] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf: Bootstrap starting.
23:48:51.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.850610 10925 tablet_bootstrap.cc:492] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967: No bootstrap required, opened a new log
23:48:51.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.850745 10922 tablet_bootstrap.cc:654] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf: Neither blocks nor log segments found. Creating new log.
23:48:51.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.850801 10925 ts_tablet_manager.cc:1403] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
23:48:51.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.850960 10923 ts_tablet_manager.cc:1434] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
23:48:51.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.851316 10923 tablet_bootstrap.cc:492] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b: Bootstrap starting.
23:48:51.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.854761 10925 raft_consensus.cc:359] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.855304 10925 raft_consensus.cc:385] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.855511 10925 raft_consensus.cc:740] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ab6d3c9b044d9c88d6a81463114967, State: Initialized, Role: FOLLOWER
23:48:51.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.855947 10923 tablet_bootstrap.cc:654] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b: Neither blocks nor log segments found. Creating new log.
23:48:51.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.855921 10925 consensus_queue.cc:260] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.856937 10925 ts_tablet_manager.cc:1434] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
23:48:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.857374 10925 tablet_bootstrap.cc:492] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967: Bootstrap starting.
23:48:51.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.858294 10064 tablet.cc:2406] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.864233 10925 tablet_bootstrap.cc:654] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967: Neither blocks nor log segments found. Creating new log.
23:48:51.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468131869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:51.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.882275 10922 tablet_bootstrap.cc:492] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf: No bootstrap required, opened a new log
23:48:51.882 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
23:48:51.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.882537 10922 ts_tablet_manager.cc:1403] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.008s
23:48:51.884 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
23:48:51.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.883744 10922 raft_consensus.cc:359] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.884088 10922 raft_consensus.cc:385] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.884174 10922 raft_consensus.cc:740] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a06e574087eb4f62863affbc0d2d5eaf, State: Initialized, Role: FOLLOWER
23:48:51.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.884733 10922 consensus_queue.cc:260] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.885383 10923 tablet_bootstrap.cc:492] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b: No bootstrap required, opened a new log
23:48:51.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.885547 10922 ts_tablet_manager.cc:1434] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
23:48:51.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.885685 10925 tablet_bootstrap.cc:492] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967: No bootstrap required, opened a new log
23:48:51.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.885910 10923 ts_tablet_manager.cc:1403] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.006s
23:48:51.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.886003 10925 ts_tablet_manager.cc:1403] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967: Time spent bootstrapping tablet: real 0.029s	user 0.002s	sys 0.010s
23:48:51.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.886957 10923 raft_consensus.cc:359] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887291 10923 raft_consensus.cc:385] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887220 10925 raft_consensus.cc:359] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887476 10925 raft_consensus.cc:385] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:51.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887503 10923 raft_consensus.cc:740] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42ee4c8ed30413397629819d068081b, State: Initialized, Role: FOLLOWER
23:48:51.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887576 10925 raft_consensus.cc:740] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ab6d3c9b044d9c88d6a81463114967, State: Initialized, Role: FOLLOWER
23:48:51.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887921 10925 consensus_queue.cc:260] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.887971 10923 consensus_queue.cc:260] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.891093 10923 ts_tablet_manager.cc:1434] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
23:48:51.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.898541 10925 ts_tablet_manager.cc:1434] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.000s
23:48:51.902 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468131902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:51.911 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:51.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
23:48:51.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:51.942744 10201 tablet.cc:2406] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:51.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.976987 10933 raft_consensus.cc:493] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:51.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.977332 10933 raft_consensus.cc:515] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.979463 10933 leader_election.cc:290] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785), a42ee4c8ed30413397629819d068081b (127.9.73.129:34153)
23:48:51.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:51.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.988677  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a063200fb74afa9665736f005dd7fe" candidate_uuid: "77ab6d3c9b044d9c88d6a81463114967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42ee4c8ed30413397629819d068081b" is_pre_election: true
23:48:51.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.988677 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a063200fb74afa9665736f005dd7fe" candidate_uuid: "77ab6d3c9b044d9c88d6a81463114967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a06e574087eb4f62863affbc0d2d5eaf" is_pre_election: true
23:48:51.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.989255 10153 raft_consensus.cc:2468] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77ab6d3c9b044d9c88d6a81463114967 in term 0.
23:48:51.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.989250  9879 raft_consensus.cc:2468] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77ab6d3c9b044d9c88d6a81463114967 in term 0.
23:48:51.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.990077  9952 leader_election.cc:304] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77ab6d3c9b044d9c88d6a81463114967, a06e574087eb4f62863affbc0d2d5eaf; no voters: 
23:48:51.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.990582 10933 raft_consensus.cc:2804] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:51.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.990764 10933 raft_consensus.cc:493] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:51.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.990916 10933 raft_consensus.cc:3060] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Advancing to term 1
23:48:51.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.993547 10933 raft_consensus.cc:515] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:51.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.994433 10933 leader_election.cc:290] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [CANDIDATE]: Term 1 election: Requested vote from peers a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785), a42ee4c8ed30413397629819d068081b (127.9.73.129:34153)
23:48:51.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.995108 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a063200fb74afa9665736f005dd7fe" candidate_uuid: "77ab6d3c9b044d9c88d6a81463114967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a06e574087eb4f62863affbc0d2d5eaf"
23:48:51.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.995184  9879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a063200fb74afa9665736f005dd7fe" candidate_uuid: "77ab6d3c9b044d9c88d6a81463114967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a42ee4c8ed30413397629819d068081b"
23:48:51.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.995425  9879 raft_consensus.cc:3060] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Advancing to term 1
23:48:51.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.995448 10153 raft_consensus.cc:3060] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Advancing to term 1
23:48:51.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.998174  9879 raft_consensus.cc:2468] T 14a063200fb74afa9665736f005dd7fe P a42ee4c8ed30413397629819d068081b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77ab6d3c9b044d9c88d6a81463114967 in term 1.
23:48:51.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.998308 10153 raft_consensus.cc:2468] T 14a063200fb74afa9665736f005dd7fe P a06e574087eb4f62863affbc0d2d5eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77ab6d3c9b044d9c88d6a81463114967 in term 1.
23:48:51.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.999035  9950 leader_election.cc:304] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77ab6d3c9b044d9c88d6a81463114967, a42ee4c8ed30413397629819d068081b; no voters: 
23:48:51.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:51.999459 10933 raft_consensus.cc:2804] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 1 FOLLOWER]: Leader election won for term 1
23:48:52.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.000233 10933 raft_consensus.cc:697] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [term 1 LEADER]: Becoming Leader. State: Replica: 77ab6d3c9b044d9c88d6a81463114967, State: Running, Role: LEADER
23:48:52.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.000885 10933 consensus_queue.cc:237] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } }
23:48:52.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.001924 10754 heartbeater.cc:499] Master 127.9.248.60:35483 was elected leader, sending a full tablet report...
23:48:52.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.008335  9558 catalog_manager.cc:5696] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130). New cstate: current_term: 1 leader_uuid: "77ab6d3c9b044d9c88d6a81463114967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } health_report { overall_health: UNKNOWN } } }
23:48:52.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.079646 10929 raft_consensus.cc:493] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:52.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.079869 10929 raft_consensus.cc:515] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:52.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.081754 10929 leader_election.cc:290] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935), a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.091089 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d946712f74c14c10a3a819b2b5fbdea4" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a06e574087eb4f62863affbc0d2d5eaf" is_pre_election: true
23:48:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.091010 10016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d946712f74c14c10a3a819b2b5fbdea4" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ab6d3c9b044d9c88d6a81463114967" is_pre_election: true
23:48:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.091408 10153 raft_consensus.cc:2468] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 0.
23:48:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.091470 10016 raft_consensus.cc:2468] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 0.
23:48:52.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.092188  9815 leader_election.cc:304] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a06e574087eb4f62863affbc0d2d5eaf, a42ee4c8ed30413397629819d068081b; no voters: 
23:48:52.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.092806 10929 raft_consensus.cc:2804] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:52.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.092969 10929 raft_consensus.cc:493] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:52.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.093135 10929 raft_consensus.cc:3060] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Advancing to term 1
23:48:52.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.095831 10929 raft_consensus.cc:515] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:52.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.096560 10929 leader_election.cc:290] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 election: Requested vote from peers 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935), a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.097294 10016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d946712f74c14c10a3a819b2b5fbdea4" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ab6d3c9b044d9c88d6a81463114967"
23:48:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.097383 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d946712f74c14c10a3a819b2b5fbdea4" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a06e574087eb4f62863affbc0d2d5eaf"
23:48:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.097522 10016 raft_consensus.cc:3060] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Advancing to term 1
23:48:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.097640 10153 raft_consensus.cc:3060] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Advancing to term 1
23:48:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.100157 10016 raft_consensus.cc:2468] T d946712f74c14c10a3a819b2b5fbdea4 P 77ab6d3c9b044d9c88d6a81463114967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 1.
23:48:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.100312 10153 raft_consensus.cc:2468] T d946712f74c14c10a3a819b2b5fbdea4 P a06e574087eb4f62863affbc0d2d5eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 1.
23:48:52.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.100788  9815 leader_election.cc:304] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77ab6d3c9b044d9c88d6a81463114967, a42ee4c8ed30413397629819d068081b; no voters: 
23:48:52.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.101263 10929 raft_consensus.cc:2804] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 1 FOLLOWER]: Leader election won for term 1
23:48:52.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.101819 10929 raft_consensus.cc:697] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [term 1 LEADER]: Becoming Leader. State: Replica: a42ee4c8ed30413397629819d068081b, State: Running, Role: LEADER
23:48:52.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.102455 10929 consensus_queue.cc:237] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:52.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.109491  9558 catalog_manager.cc:5696] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b reported cstate change: term changed from 0 to 1, leader changed from <none> to a42ee4c8ed30413397629819d068081b (127.9.73.129). New cstate: current_term: 1 leader_uuid: "a42ee4c8ed30413397629819d068081b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } health_report { overall_health: UNKNOWN } } }
23:48:52.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.214216 10929 raft_consensus.cc:493] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:52.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.214478 10929 raft_consensus.cc:515] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:52.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.215342 10929 leader_election.cc:290] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935), a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.216252 10016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf762a7433f4690bd8243d3ae223cfe" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ab6d3c9b044d9c88d6a81463114967" is_pre_election: true
23:48:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.216588 10016 raft_consensus.cc:2468] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 0.
23:48:52.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.216779 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf762a7433f4690bd8243d3ae223cfe" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a06e574087eb4f62863affbc0d2d5eaf" is_pre_election: true
23:48:52.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.217124 10153 raft_consensus.cc:2468] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 0.
23:48:52.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.217175  9815 leader_election.cc:304] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77ab6d3c9b044d9c88d6a81463114967, a42ee4c8ed30413397629819d068081b; no voters: 
23:48:52.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.217674 10929 raft_consensus.cc:2804] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:52.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.217764 10929 raft_consensus.cc:493] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:52.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.217846 10929 raft_consensus.cc:3060] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 0 FOLLOWER]: Advancing to term 1
23:48:52.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.220005 10929 raft_consensus.cc:515] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:52.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.220590 10929 leader_election.cc:290] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 election: Requested vote from peers 77ab6d3c9b044d9c88d6a81463114967 (127.9.73.130:43935), a06e574087eb4f62863affbc0d2d5eaf (127.9.73.131:40785)
23:48:52.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.221225 10016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf762a7433f4690bd8243d3ae223cfe" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77ab6d3c9b044d9c88d6a81463114967"
23:48:52.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.221288 10153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf762a7433f4690bd8243d3ae223cfe" candidate_uuid: "a42ee4c8ed30413397629819d068081b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a06e574087eb4f62863affbc0d2d5eaf"
23:48:52.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.221489 10153 raft_consensus.cc:3060] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [term 0 FOLLOWER]: Advancing to term 1
23:48:52.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.221467 10016 raft_consensus.cc:3060] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [term 0 FOLLOWER]: Advancing to term 1
23:48:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.223847 10016 raft_consensus.cc:2468] T 8cf762a7433f4690bd8243d3ae223cfe P 77ab6d3c9b044d9c88d6a81463114967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 1.
23:48:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.223908 10153 raft_consensus.cc:2468] T 8cf762a7433f4690bd8243d3ae223cfe P a06e574087eb4f62863affbc0d2d5eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a42ee4c8ed30413397629819d068081b in term 1.
23:48:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.224484  9815 leader_election.cc:304] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77ab6d3c9b044d9c88d6a81463114967, a42ee4c8ed30413397629819d068081b; no voters: 
23:48:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.224860 10929 raft_consensus.cc:2804] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 1 FOLLOWER]: Leader election won for term 1
23:48:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.225168 10929 raft_consensus.cc:697] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [term 1 LEADER]: Becoming Leader. State: Replica: a42ee4c8ed30413397629819d068081b, State: Running, Role: LEADER
23:48:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.225477 10929 consensus_queue.cc:237] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } }
23:48:52.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.228850  9558 catalog_manager.cc:5696] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b reported cstate change: term changed from 0 to 1, leader changed from <none> to a42ee4c8ed30413397629819d068081b (127.9.73.129). New cstate: current_term: 1 leader_uuid: "a42ee4c8ed30413397629819d068081b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 } health_report { overall_health: UNKNOWN } } }
23:48:52.256 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:52.256 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:52.256 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:52.256 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:52.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:52.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:52.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:52.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:52.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:52.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:52.257 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:52.257 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:52.257 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:52.369 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468132369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:52.377 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:52.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
23:48:52.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.383759 10933 consensus_queue.cc:1048] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a42ee4c8ed30413397629819d068081b" member_type: VOTER last_known_addr { host: "127.9.73.129" port: 34153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:52.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.399480 10933 consensus_queue.cc:1048] T 14a063200fb74afa9665736f005dd7fe P 77ab6d3c9b044d9c88d6a81463114967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:52.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468132402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:52.415 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:52.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
23:48:52.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:52.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:52.491 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 14a063200fb74afa9665736f005dd7fe for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:52.491 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8cf762a7433f4690bd8243d3ae223cfe for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:52.492 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d946712f74c14c10a3a819b2b5fbdea4 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:52.492 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=14a063200fb74afa9665736f005dd7fe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)[L],a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=8cf762a7433f4690bd8243d3ae223cfe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=d946712f74c14c10a3a819b2b5fbdea4@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}]
23:48:52.492 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.73.190:40177, [3ms] Sub RPC GetTableLocations: received response from server master-127.9.73.190:40177: OK, deferred=null) after lookup
23:48:52.493 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)] connecting to peer
23:48:52.494 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)] Successfully connected to peer
23:48:52.507 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.510 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x54001c26, L:/127.0.0.1:50484 - R:/127.9.73.130:43935] using TOKEN/null
23:48:52.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.567062 10889 heartbeater.cc:499] Master 127.9.248.60:35483 was elected leader, sending a full tablet report...
23:48:52.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.630774 10929 consensus_queue.cc:1048] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:52.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.638295 10946 consensus_queue.cc:1048] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [LEADER]: Connected to new peer: Peer: permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:52.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.642391 10946 consensus_queue.cc:1048] T 8cf762a7433f4690bd8243d3ae223cfe P a42ee4c8ed30413397629819d068081b [LEADER]: Connected to new peer: Peer: permanent_uuid: "77ab6d3c9b044d9c88d6a81463114967" member_type: VOTER last_known_addr { host: "127.9.73.130" port: 43935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:52.663 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:52.665 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:52.667 [DEBUG - main] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:48:52.668 [DEBUG - main] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:48:52.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.675791 10929 consensus_queue.cc:1048] T d946712f74c14c10a3a819b2b5fbdea4 P a42ee4c8ed30413397629819d068081b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a06e574087eb4f62863affbc0d2d5eaf" member_type: VOTER last_known_addr { host: "127.9.73.131" port: 40785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:52.677 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.61:36251(127.9.248.61:36251)] Successfully connected to peer
23:48:52.682 [DEBUG - main] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:48:52.684 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:52.684 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:52.684 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:52.684 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:52.684 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:52.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:52.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:52.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:52.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:52.685 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.60:35483(127.9.248.60:35483)] Successfully connected to peer
23:48:52.685 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:52.685 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:52.685 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:52.685 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:52.688 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.60
23:48:52.689 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.61
23:48:52.693 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.62:39393(127.9.248.62:39393)] Successfully connected to peer
23:48:52.698 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.62
23:48:52.699 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.702 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.702 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8b999902, L:/127.0.0.1:42512 - R:/127.9.248.60:35483] using SASL/PLAIN
23:48:52.704 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:52.704 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=39), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.61:36251, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.60:35483, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.62:39393, [38ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.60:35483: OK, deferred=null) after lookup
23:48:52.708 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.711 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf30a9952, L:/127.0.0.1:59252 - R:/127.9.248.62:39393] using SASL/PLAIN
23:48:52.715 [DEBUG - main] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:48:52.715 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaa7ae260, L:/127.0.0.1:49230 - R:/127.9.248.61:36251] using SASL/PLAIN
23:48:52.718 [DEBUG - main] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:52.719 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.73.188:35043(127.9.73.188:35043)] Successfully connected to peer
23:48:52.721 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.188
23:48:52.723 [DEBUG - main] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:52.730 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.73.189:33103(127.9.73.189:33103)] Successfully connected to peer
23:48:52.735 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.73.190:40177(127.9.73.190:40177)] Successfully connected to peer
23:48:52.735 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.189
23:48:52.737 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.190
23:48:52.750 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.758 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.759 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x25dfcf0f, L:/127.0.0.1:56772 - R:/127.9.73.190:40177] using SASL/PLAIN
23:48:52.765 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0b6fbf54, L:/127.0.0.1:57278 - R:/127.9.73.188:35043] using SASL/PLAIN
23:48:52.765 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:52.765 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=59), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [51ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: OK, deferred=null) after lookup
23:48:52.768 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:52.771 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 14a063200fb74afa9665736f005dd7fe for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:52.771 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8cf762a7433f4690bd8243d3ae223cfe for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:52.771 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d946712f74c14c10a3a819b2b5fbdea4 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:52.771 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=14a063200fb74afa9665736f005dd7fe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)[L],a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=8cf762a7433f4690bd8243d3ae223cfe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=d946712f74c14c10a3a819b2b5fbdea4@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}]
23:48:52.759 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:52.777 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x34665f3a, L:/127.0.0.1:33114 - R:/127.9.73.189:33103] using SASL/PLAIN
23:48:52.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.774144 10395 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42512:
23:48:52.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:48:52.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\001d\000\000\000"
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:48:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:48:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:48:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:48:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:48:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:48:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:52.776685 10395 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:48:52.817 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:52.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468132869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:52.883 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:48:52.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
23:48:52.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.885013 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 31304b7d60d54d1ab082807886eef61c (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION VALUES < 100
23:48:52.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.885390 10824 tablet_service.cc:1511] Processing CreateTablet for tablet 31304b7d60d54d1ab082807886eef61c (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION VALUES < 100
23:48:52.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.887898 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31304b7d60d54d1ab082807886eef61c. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:52.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.887939 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31304b7d60d54d1ab082807886eef61c. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:52.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.889969 10553 tablet_service.cc:1511] Processing CreateTablet for tablet 31304b7d60d54d1ab082807886eef61c (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION VALUES < 100
23:48:52.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.892190 10553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31304b7d60d54d1ab082807886eef61c. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:52.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468132902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:52.914 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:52.916 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
23:48:52.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.924132 10998 tablet_bootstrap.cc:492] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: Bootstrap starting.
23:48:52.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.924751 10997 tablet_bootstrap.cc:492] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: Bootstrap starting.
23:48:52.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.929186 10998 tablet_bootstrap.cc:654] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: Neither blocks nor log segments found. Creating new log.
23:48:52.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.930552 10998 log.cc:826] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: Log is configured to *not* fsync() on all Append() calls
23:48:52.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.930897 10999 tablet_bootstrap.cc:492] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: Bootstrap starting.
23:48:52.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.932673 10997 tablet_bootstrap.cc:654] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: Neither blocks nor log segments found. Creating new log.
23:48:52.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.937038 10997 log.cc:826] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: Log is configured to *not* fsync() on all Append() calls
23:48:52.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.939502 10999 tablet_bootstrap.cc:654] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: Neither blocks nor log segments found. Creating new log.
23:48:52.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.940555 10998 tablet_bootstrap.cc:492] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: No bootstrap required, opened a new log
23:48:52.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.940884 10998 ts_tablet_manager.cc:1403] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
23:48:52.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.941287 10999 log.cc:826] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: Log is configured to *not* fsync() on all Append() calls
23:48:52.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.948772 10998 raft_consensus.cc:359] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:52.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.949316 10998 raft_consensus.cc:385] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:52.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.949420 10998 raft_consensus.cc:740] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bbd3b7684d64d54bae378c85bb641f3, State: Initialized, Role: FOLLOWER
23:48:52.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.950321 10998 consensus_queue.cc:260] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:52.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.952610 10999 tablet_bootstrap.cc:492] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: No bootstrap required, opened a new log
23:48:52.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.955654 10997 tablet_bootstrap.cc:492] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: No bootstrap required, opened a new log
23:48:52.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.956176 10997 ts_tablet_manager.cc:1403] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
23:48:52.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.958784 10999 ts_tablet_manager.cc:1403] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
23:48:52.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.959260 10998 ts_tablet_manager.cc:1434] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.005s
23:48:52.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.975317 10997 raft_consensus.cc:359] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:52.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.977134 10997 raft_consensus.cc:385] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:52.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.977437 10997 raft_consensus.cc:740] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a147bd31ba747b29bca1dbfb99edafa, State: Initialized, Role: FOLLOWER
23:48:52.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.976805 10999 raft_consensus.cc:359] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:52.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.979159 10999 raft_consensus.cc:385] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:52.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.979280 10999 raft_consensus.cc:740] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 783d9938b0e042a59f828e194dbbd5fc, State: Initialized, Role: FOLLOWER
23:48:52.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.980041 10999 consensus_queue.cc:260] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:52.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.978785 10997 consensus_queue.cc:260] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:52.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.982326 10999 ts_tablet_manager.cc:1434] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
23:48:52.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:52.982982 10757 tablet.cc:2406] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:52.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:52.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:52.988981 10626 tablet.cc:2406] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:52.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:52.989621 10997 ts_tablet_manager.cc:1434] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.006s
23:48:53.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:53.043540 10892 tablet.cc:2406] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:48:53.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.107569 11003 raft_consensus.cc:493] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:53.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.107920 11003 raft_consensus.cc:515] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:53.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.110540 11003 leader_election.cc:290] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.131035 10573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31304b7d60d54d1ab082807886eef61c" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "783d9938b0e042a59f828e194dbbd5fc" is_pre_election: true
23:48:53.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.131639 10573 raft_consensus.cc:2468] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 0.
23:48:53.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.132622 10644 leader_election.cc:304] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bbd3b7684d64d54bae378c85bb641f3, 783d9938b0e042a59f828e194dbbd5fc; no voters: 
23:48:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.133170 11003 raft_consensus.cc:2804] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.133350 11003 raft_consensus.cc:493] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.133472 11003 raft_consensus.cc:3060] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Advancing to term 1
23:48:53.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.139053 11003 raft_consensus.cc:515] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:53.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.140144 11003 leader_election.cc:290] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 election: Requested vote from peers 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.141372 10573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31304b7d60d54d1ab082807886eef61c" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "783d9938b0e042a59f828e194dbbd5fc"
23:48:53.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.141614 10573 raft_consensus.cc:3060] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Advancing to term 1
23:48:53.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.145434 10573 raft_consensus.cc:2468] T 31304b7d60d54d1ab082807886eef61c P 783d9938b0e042a59f828e194dbbd5fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 1.
23:48:53.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.147326 10644 leader_election.cc:304] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bbd3b7684d64d54bae378c85bb641f3, 783d9938b0e042a59f828e194dbbd5fc; no voters: 
23:48:53.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.148075 11003 raft_consensus.cc:2804] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 FOLLOWER]: Leader election won for term 1
23:48:53.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.149216 10843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31304b7d60d54d1ab082807886eef61c" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa"
23:48:53.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.149734 10843 raft_consensus.cc:3060] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Advancing to term 1
23:48:53.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.153412 10843 raft_consensus.cc:2468] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 1.
23:48:53.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.154011 10844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31304b7d60d54d1ab082807886eef61c" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa" is_pre_election: true
23:48:53.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.154371 10844 raft_consensus.cc:2376] T 31304b7d60d54d1ab082807886eef61c P 7a147bd31ba747b29bca1dbfb99edafa [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 1. Re-sending same reply.
23:48:53.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.168565 11003 raft_consensus.cc:697] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0bbd3b7684d64d54bae378c85bb641f3, State: Running, Role: LEADER
23:48:53.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.169625 11003 consensus_queue.cc:237] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } }
23:48:53.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.184374 10394 catalog_manager.cc:5696] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2). New cstate: current_term: 1 leader_uuid: "0bbd3b7684d64d54bae378c85bb641f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } health_report { overall_health: HEALTHY } } }
23:48:53.203 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state RESTARTING to RUNNING.
23:48:53.204 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job bbc34d76ac15add629743db00c4f4a33 from Checkpoint 66 @ 1783468100667 for bbc34d76ac15add629743db00c4f4a33 located at file:/tmp/junit16513366076383754312/checkpoints/bbc34d76ac15add629743db00c4f4a33/chk-66.
23:48:53.205 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
23:48:53.205 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
23:48:53.206 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 66 for source Source: KuduSource to checkpoint.
23:48:53.207 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:53.208 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
23:48:53.208 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758
23:48:53.208 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:48:53.210 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:48:53.219 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
23:48:53.219 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
23:48:53.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:53.222 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1eaead3b
23:48:53.222 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:53.222 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:48:53.222 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
23:48:53.223 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
23:48:53.234 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4521f577
23:48:53.238 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:53.239 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.240 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.242 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.244 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.260 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.261 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.261 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.263 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.280 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.281 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.281 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.281 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.282 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.282 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.282 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.301 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.301 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.301 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.320 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.320 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.321 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.321 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.321 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.321 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.321 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.321 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.321 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.322 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.340 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.340 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.341 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.341 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.341 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.341 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.342 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468133369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:53.380 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:53.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
23:48:53.387 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:53.388 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:53.388 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:53.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:53.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:53.388 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:53.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:53.388 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:53.388 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:53.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:53.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:53.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:53.389 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:53.400 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.400 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.401 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.401 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.402 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.402 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.402 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.402 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.403 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468133402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:53.412 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:53.412 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
23:48:53.480 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.480 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.480 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.481 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.481 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.481 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.481 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.481 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.482 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:53.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.611115 10394 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42512:
23:48:53.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
23:48:53.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:53.621920 10394 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7299f299e13343548f3341a23e5a0ee0 has no consensus state
23:48:53.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.634473 10553 tablet_service.cc:1511] Processing CreateTablet for tablet 7299f299e13343548f3341a23e5a0ee0 (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:53.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.634825 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 7299f299e13343548f3341a23e5a0ee0 (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:53.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.635027 10553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7299f299e13343548f3341a23e5a0ee0. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:53.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.635263 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7299f299e13343548f3341a23e5a0ee0. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:53.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.638247 10824 tablet_service.cc:1511] Processing CreateTablet for tablet 7299f299e13343548f3341a23e5a0ee0 (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
23:48:53.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.638700 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7299f299e13343548f3341a23e5a0ee0. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:53.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.653578 11026 tablet_bootstrap.cc:492] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa: Bootstrap starting.
23:48:53.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.654963 11024 tablet_bootstrap.cc:492] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3: Bootstrap starting.
23:48:53.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:53.656458 10380 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 7299f299e13343548f3341a23e5a0ee0 (table replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7299f299e13343548f3341a23e5a0ee0 consensus state has no leader
23:48:53.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.656986 11026 tablet_bootstrap.cc:654] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa: Neither blocks nor log segments found. Creating new log.
23:48:53.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.657474 11024 tablet_bootstrap.cc:654] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3: Neither blocks nor log segments found. Creating new log.
23:48:53.659 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.660 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.660 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.660 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.660 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.661 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.661 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.661 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.661 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.661 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.663532 11003 consensus_queue.cc:1048] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:53.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.669587 11025 tablet_bootstrap.cc:492] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc: Bootstrap starting.
23:48:53.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.676317 11025 tablet_bootstrap.cc:654] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc: Neither blocks nor log segments found. Creating new log.
23:48:53.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.682302 11025 tablet_bootstrap.cc:492] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc: No bootstrap required, opened a new log
23:48:53.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.682785 11025 ts_tablet_manager.cc:1403] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.000s
23:48:53.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.684696 11025 raft_consensus.cc:359] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.685057 11025 raft_consensus.cc:385] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:53.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.685312 11025 raft_consensus.cc:740] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 783d9938b0e042a59f828e194dbbd5fc, State: Initialized, Role: FOLLOWER
23:48:53.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.685822 11025 consensus_queue.cc:260] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.688099 11025 ts_tablet_manager.cc:1434] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
23:48:53.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.695742 11026 tablet_bootstrap.cc:492] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa: No bootstrap required, opened a new log
23:48:53.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.696286 11026 ts_tablet_manager.cc:1403] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.012s
23:48:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.697817 11026 raft_consensus.cc:359] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.698173 11026 raft_consensus.cc:385] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.698468 11026 raft_consensus.cc:740] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a147bd31ba747b29bca1dbfb99edafa, State: Initialized, Role: FOLLOWER
23:48:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.698715 11030 consensus_queue.cc:1048] T 31304b7d60d54d1ab082807886eef61c P 0bbd3b7684d64d54bae378c85bb641f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:53.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.699116 11024 tablet_bootstrap.cc:492] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3: No bootstrap required, opened a new log
23:48:53.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.698897 11026 consensus_queue.cc:260] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.699285 11024 ts_tablet_manager.cc:1403] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.007s
23:48:53.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.700477 11024 raft_consensus.cc:359] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.700677 11024 raft_consensus.cc:385] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:53.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.700793 11024 raft_consensus.cc:740] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bbd3b7684d64d54bae378c85bb641f3, State: Initialized, Role: FOLLOWER
23:48:53.701 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:53.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.701056 11024 consensus_queue.cc:260] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.701 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:53.701 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:53.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.701632 11024 ts_tablet_manager.cc:1434] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:48:53.702 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.702 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.702 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:53.703 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.703 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.703 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:53.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:53.707 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:53.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.716323 10394 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20] alter complete (version 0)
23:48:53.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.717722 11026 ts_tablet_manager.cc:1434] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.016s
23:48:53.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:53.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.730644 10393 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42512:
23:48:53.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\310\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
23:48:53.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:53.747006 10393 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7299f299e13343548f3341a23e5a0ee0 consensus state has no leader
23:48:53.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:53.747215 10393 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 has no consensus state
23:48:53.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.754932 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION 200 <= VALUES
23:48:53.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.755223 10824 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION 200 <= VALUES
23:48:53.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.755578 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcdfcdfd6d94f1a948e22bca1e8e917. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:53.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.755797 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcdfcdfd6d94f1a948e22bca1e8e917. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:53.759 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:53.759 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:53.759 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:53.760 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:53.760 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:53.760 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:53.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:53.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:53.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:53.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:53.761 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:53.761 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:53.761 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.759020 10553 tablet_service.cc:1511] Processing CreateTablet for tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 (DEFAULT_TABLE table=replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20]), partition=RANGE (key1) PARTITION 200 <= VALUES
23:48:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.759517 10553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dcdfcdfd6d94f1a948e22bca1e8e917. 1 dirs total, 0 dirs full, 0 dirs failed
23:48:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.761631 11026 tablet_bootstrap.cc:492] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa: Bootstrap starting.
23:48:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.761834 11024 tablet_bootstrap.cc:492] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3: Bootstrap starting.
23:48:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.763227 11026 tablet_bootstrap.cc:654] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa: Neither blocks nor log segments found. Creating new log.
23:48:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.763626 11024 tablet_bootstrap.cc:654] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3: Neither blocks nor log segments found. Creating new log.
23:48:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.765352 11026 tablet_bootstrap.cc:492] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa: No bootstrap required, opened a new log
23:48:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.765560 11026 ts_tablet_manager.cc:1403] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
23:48:53.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.766472 11026 raft_consensus.cc:359] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.766693 11026 raft_consensus.cc:385] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:53.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.767041 11025 tablet_bootstrap.cc:492] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc: Bootstrap starting.
23:48:53.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.768564 11024 tablet_bootstrap.cc:492] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3: No bootstrap required, opened a new log
23:48:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.768709 11024 ts_tablet_manager.cc:1403] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
23:48:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.768793 11025 tablet_bootstrap.cc:654] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc: Neither blocks nor log segments found. Creating new log.
23:48:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.769464 11024 raft_consensus.cc:359] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.769652 11024 raft_consensus.cc:385] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.769711 11024 raft_consensus.cc:740] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bbd3b7684d64d54bae378c85bb641f3, State: Initialized, Role: FOLLOWER
23:48:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.769855 11026 raft_consensus.cc:740] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a147bd31ba747b29bca1dbfb99edafa, State: Initialized, Role: FOLLOWER
23:48:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.769974 11024 consensus_queue.cc:260] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.770243 11026 consensus_queue.cc:260] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.770857 11026 ts_tablet_manager.cc:1434] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
23:48:53.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.772490 11025 tablet_bootstrap.cc:492] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc: No bootstrap required, opened a new log
23:48:53.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.772668 11025 ts_tablet_manager.cc:1403] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.001s
23:48:53.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.773547 11025 raft_consensus.cc:359] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.773772 11025 raft_consensus.cc:385] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:48:53.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.773918 11025 raft_consensus.cc:740] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 783d9938b0e042a59f828e194dbbd5fc, State: Initialized, Role: FOLLOWER
23:48:53.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.774222 11025 consensus_queue.cc:260] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.775137 11024 ts_tablet_manager.cc:1434] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.001s
23:48:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.779233 11025 ts_tablet_manager.cc:1434] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
23:48:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.780333 10393 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 0cdf181a384940568e6c18a17a93b97e: replication_test_table [id=8d4e3cc5537d45f2ba7e14cf9108cf20] alter complete (version 0)
23:48:53.789 [DEBUG - main] (Connection.java:575) [peer master-127.9.73.189:33103(127.9.73.189:33103)] disconnecting while in state READY
23:48:53.789 [DEBUG - main] (Connection.java:575) [peer master-127.9.73.188:35043(127.9.73.188:35043)] disconnecting while in state READY
23:48:53.789 [DEBUG - main] (Connection.java:575) [peer master-127.9.73.190:40177(127.9.73.190:40177)] disconnecting while in state READY
23:48:53.789 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.73.188:35043(127.9.73.188:35043)] handling channelInactive
23:48:53.789 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state READY due to: connection closed
23:48:53.790 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:53.789 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.73.189:33103(127.9.73.189:33103)] handling channelInactive
23:48:53.791 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state READY due to: connection closed
23:48:53.791 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:48:53.792 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
23:48:53.793 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.73.190:40177(127.9.73.190:40177)] handling channelInactive
23:48:53.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state READY due to: connection closed
23:48:53.793 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.61:36251(127.9.248.61:36251)] disconnecting while in state READY
23:48:53.793 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.62:39393(127.9.248.62:39393)] disconnecting while in state READY
23:48:53.793 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.60:35483(127.9.248.60:35483)] disconnecting while in state READY
23:48:53.793 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
23:48:53.793 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.61:36251(127.9.248.61:36251)] handling channelInactive
23:48:53.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state READY due to: connection closed
23:48:53.793 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.62:39393(127.9.248.62:39393)] handling channelInactive
23:48:53.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state READY due to: connection closed
23:48:53.793 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:53.795 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:53.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.794950 11035 raft_consensus.cc:493] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:53.795 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:48:53.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.795202 11035 raft_consensus.cc:515] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.796 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.60:35483(127.9.248.60:35483)] handling channelInactive
23:48:53.796 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state READY due to: connection closed
23:48:53.796 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:48:53.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.797381 11035 leader_election.cc:290] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283), 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803)
23:48:53.798 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:53.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.798230 11030 raft_consensus.cc:493] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:53.798 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:48:53.799 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:48:53.799 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:53.799 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:53.799 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:48:53.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.798502 11030 raft_consensus.cc:515] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.799165 11028 raft_consensus.cc:493] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.799340 11028 raft_consensus.cc:515] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.799638 11030 leader_election.cc:290] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.800505 10843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa" is_pre_election: true
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.800740 10843 raft_consensus.cc:2468] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 0.
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.801326 10643 leader_election.cc:304] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bbd3b7684d64d54bae378c85bb641f3, 7a147bd31ba747b29bca1dbfb99edafa; no voters: 
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.801397 11028 leader_election.cc:290] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.801762 11030 raft_consensus.cc:2804] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.801865 11030 raft_consensus.cc:493] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.801966 11030 raft_consensus.cc:3060] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Advancing to term 1
23:48:53.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.809985 11030 raft_consensus.cc:515] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.820087 10843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa"
23:48:53.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.820459 10843 raft_consensus.cc:3060] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Advancing to term 1
23:48:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.821172 11028 raft_consensus.cc:493] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:48:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.821381 11028 raft_consensus.cc:515] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.821522 10572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "783d9938b0e042a59f828e194dbbd5fc" is_pre_election: true
23:48:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.821870 10572 raft_consensus.cc:2468] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 0.
23:48:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.822105 11028 leader_election.cc:290] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.823450 10572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "0bbd3b7684d64d54bae378c85bb641f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "783d9938b0e042a59f828e194dbbd5fc"
23:48:53.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.823743 10572 raft_consensus.cc:3060] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Advancing to term 1
23:48:53.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.824846 10843 raft_consensus.cc:2468] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 1.
23:48:53.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.826336 10643 leader_election.cc:304] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bbd3b7684d64d54bae378c85bb641f3, 7a147bd31ba747b29bca1dbfb99edafa; no voters: 
23:48:53.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.829459 10572 raft_consensus.cc:2468] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bbd3b7684d64d54bae378c85bb641f3 in term 1.
23:48:53.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.831462 11003 raft_consensus.cc:2804] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 FOLLOWER]: Leader election won for term 1
23:48:53.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.832911 11003 raft_consensus.cc:697] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0bbd3b7684d64d54bae378c85bb641f3, State: Running, Role: LEADER
23:48:53.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.833761 11003 consensus_queue.cc:237] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.838359 11030 leader_election.cc:290] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [CANDIDATE]: Term 1 election: Requested vote from peers 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.840703 10393 catalog_manager.cc:5696] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2). New cstate: current_term: 1 leader_uuid: "0bbd3b7684d64d54bae378c85bb641f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } health_report { overall_health: UNKNOWN } } }
23:48:53.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.850419 10572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "7a147bd31ba747b29bca1dbfb99edafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "783d9938b0e042a59f828e194dbbd5fc" is_pre_election: true
23:48:53.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.850826 10572 raft_consensus.cc:2393] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a147bd31ba747b29bca1dbfb99edafa in current term 1: Already voted for candidate 0bbd3b7684d64d54bae378c85bb641f3 in this term.
23:48:53.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.857010 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "7a147bd31ba747b29bca1dbfb99edafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bbd3b7684d64d54bae378c85bb641f3" is_pre_election: true
23:48:53.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.858021 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcdfcdfd6d94f1a948e22bca1e8e917" candidate_uuid: "783d9938b0e042a59f828e194dbbd5fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bbd3b7684d64d54bae378c85bb641f3" is_pre_election: true
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.858387 10708 raft_consensus.cc:2468] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 783d9938b0e042a59f828e194dbbd5fc in term 0.
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.858784 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "783d9938b0e042a59f828e194dbbd5fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bbd3b7684d64d54bae378c85bb641f3" is_pre_election: true
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.858955 10509 leader_election.cc:304] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bbd3b7684d64d54bae378c85bb641f3, 783d9938b0e042a59f828e194dbbd5fc; no voters: 
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.859480 11028 raft_consensus.cc:2804] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Leader pre-election won for term 1
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.859614 11028 raft_consensus.cc:493] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.859546 10843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcdfcdfd6d94f1a948e22bca1e8e917" candidate_uuid: "783d9938b0e042a59f828e194dbbd5fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa" is_pre_election: true
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.859721 11028 raft_consensus.cc:3060] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 0 FOLLOWER]: Advancing to term 1
23:48:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.859817 10843 raft_consensus.cc:2468] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 783d9938b0e042a59f828e194dbbd5fc in term 0.
23:48:53.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.860479 10843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7299f299e13343548f3341a23e5a0ee0" candidate_uuid: "783d9938b0e042a59f828e194dbbd5fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa" is_pre_election: true
23:48:53.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.860698 10843 raft_consensus.cc:2393] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 783d9938b0e042a59f828e194dbbd5fc in current term 1: Already voted for candidate 0bbd3b7684d64d54bae378c85bb641f3 in this term.
23:48:53.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:48:53.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:53.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.861019 10780 leader_election.cc:304] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a147bd31ba747b29bca1dbfb99edafa; no voters: 0bbd3b7684d64d54bae378c85bb641f3, 783d9938b0e042a59f828e194dbbd5fc
23:48:53.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:48:53.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:48:53.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:48:53.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:48:53.861 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:48:53.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.861464 11035 raft_consensus.cc:2749] T 7299f299e13343548f3341a23e5a0ee0 P 7a147bd31ba747b29bca1dbfb99edafa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:48:53.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.862113 10507 leader_election.cc:304] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 783d9938b0e042a59f828e194dbbd5fc; no voters: 0bbd3b7684d64d54bae378c85bb641f3, 7a147bd31ba747b29bca1dbfb99edafa
23:48:53.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.863058 11062 raft_consensus.cc:2749] T 7299f299e13343548f3341a23e5a0ee0 P 783d9938b0e042a59f828e194dbbd5fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:48:53.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.863161 11028 raft_consensus.cc:515] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.865054 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcdfcdfd6d94f1a948e22bca1e8e917" candidate_uuid: "783d9938b0e042a59f828e194dbbd5fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bbd3b7684d64d54bae378c85bb641f3"
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.865185 11028 leader_election.cc:290] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [CANDIDATE]: Term 1 election: Requested vote from peers 0bbd3b7684d64d54bae378c85bb641f3 (127.9.248.2:38803), 7a147bd31ba747b29bca1dbfb99edafa (127.9.248.3:36277)
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.865309 10707 raft_consensus.cc:3060] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [term 0 FOLLOWER]: Advancing to term 1
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.865756 10843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dcdfcdfd6d94f1a948e22bca1e8e917" candidate_uuid: "783d9938b0e042a59f828e194dbbd5fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a147bd31ba747b29bca1dbfb99edafa"
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.865932 10843 raft_consensus.cc:3060] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [term 0 FOLLOWER]: Advancing to term 1
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.868327 10843 raft_consensus.cc:2468] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 7a147bd31ba747b29bca1dbfb99edafa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 783d9938b0e042a59f828e194dbbd5fc in term 1.
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.868688 10707 raft_consensus.cc:2468] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 0bbd3b7684d64d54bae378c85bb641f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 783d9938b0e042a59f828e194dbbd5fc in term 1.
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.868794 10507 leader_election.cc:304] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 783d9938b0e042a59f828e194dbbd5fc, 7a147bd31ba747b29bca1dbfb99edafa; no voters: 
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.869180 11028 raft_consensus.cc:2804] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 1 FOLLOWER]: Leader election won for term 1
23:48:53.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.869354 11028 raft_consensus.cc:697] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [term 1 LEADER]: Becoming Leader. State: Replica: 783d9938b0e042a59f828e194dbbd5fc, State: Running, Role: LEADER
23:48:53.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468133869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:53.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.870164 11028 consensus_queue.cc:237] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } }
23:48:53.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:53.875836 10393 catalog_manager.cc:5696] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1). New cstate: current_term: 1 leader_uuid: "783d9938b0e042a59f828e194dbbd5fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 } health_report { overall_health: UNKNOWN } } }
23:48:53.880 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:53.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
23:48:53.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468133903 for job 6b15b774f375318429e8c166741c1d9d.
23:48:53.914 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:53.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
23:48:53.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:54.056 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:54.056 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:54.056 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:54.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.057 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:54.060 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:54.060 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:54.060 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:54.060 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:54.061 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:54.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:54.061 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:54.061 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:54.061 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:54.061 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:54.061 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:54.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:54.061 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:54.078 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:48:54.133 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:48:54.133 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:48:54.133 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:48:54.149 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:54.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:54.279 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:54.280 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:54.280 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:54.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:54.280 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:54.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:54.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:54.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:54.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:54.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:54.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:54.282 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:54.282 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:54.283 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:54.283 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:54.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.283 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:54.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.284 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:54.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:54.291764 11028 consensus_queue.cc:1048] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:54.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:54.304720 11028 consensus_queue.cc:1048] T 3dcdfcdfd6d94f1a948e22bca1e8e917 P 783d9938b0e042a59f828e194dbbd5fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bbd3b7684d64d54bae378c85bb641f3" member_type: VOTER last_known_addr { host: "127.9.248.2" port: 38803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:54.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:54.315183 11056 consensus_queue.cc:1048] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "783d9938b0e042a59f828e194dbbd5fc" member_type: VOTER last_known_addr { host: "127.9.248.1" port: 35283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:54.330271 11030 consensus_queue.cc:1048] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a147bd31ba747b29bca1dbfb99edafa" member_type: VOTER last_known_addr { host: "127.9.248.3" port: 36277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:48:54.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468134369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:54.381 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:48:54.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
23:48:54.402 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468134402 for job 6b15b774f375318429e8c166741c1d9d.
23:48:54.403 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:54.404 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:54.404 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:54.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.404 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:54.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:54.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.405 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:54.405 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:54.413 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:54.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
23:48:54.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:54.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:54.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468134869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:54.879 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:54.895 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
23:48:54.903 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468134902 for job 6b15b774f375318429e8c166741c1d9d.
23:48:54.913 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 6b15b774f375318429e8c166741c1d9d (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:54.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
23:48:54.957 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:54.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:55.076 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.076 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.077 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.077 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.078 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.078 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.078 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.078 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.079 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29689), Traces: [0ms] sending RPC to server master-127.5.195.124:40929, [3ms] received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [6ms] refreshing cache from master, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [8ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [10ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [26ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [29ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [31ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [48ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [66ms] refreshing cache from master, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [67ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [68ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [88ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [126ms] refreshing cache from master, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [129ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [129ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [226ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [229ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [229ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [266ms] refreshing cache from master, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [268ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [506ms] refreshing cache from master, [506ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [511ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [513ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [767ms] refreshing cache from master, [767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [768ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [769ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1806ms] refreshing cache from master, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1808ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5647ms] refreshing cache from master, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [5649ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [6986ms] refreshing cache from master, [6986ms] too many traces: truncated at 100 traces, deferred=Deferred@1861795443(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@30d0ec0a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585)))
23:48:55.080 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.081 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.081 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.081 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.081 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.081 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.080 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29689), Traces: [0ms] sending RPC to server master-127.5.195.124:40929, [3ms] received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [6ms] refreshing cache from master, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [8ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [10ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [26ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [29ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [31ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [48ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [66ms] refreshing cache from master, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [67ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [68ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [88ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [126ms] refreshing cache from master, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [129ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [129ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [226ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [229ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [229ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [266ms] refreshing cache from master, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [268ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [506ms] refreshing cache from master, [506ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [511ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [513ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [767ms] refreshing cache from master, [767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [768ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [769ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1806ms] refreshing cache from master, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1808ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5647ms] refreshing cache from master, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [5649ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [6986ms] refreshing cache from master, [6986ms] too many traces: truncated at 100 traces, deferred=Deferred@1861795443(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@30d0ec0a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29689), Traces: [0ms] sending RPC to server master-127.5.195.124:40929, [3ms] received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [6ms] refreshing cache from master, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [8ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [10ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [26ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [29ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [31ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [48ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [66ms] refreshing cache from master, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [67ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [68ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [88ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [126ms] refreshing cache from master, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [129ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [129ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [226ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [229ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [229ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [266ms] refreshing cache from master, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [268ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [506ms] refreshing cache from master, [506ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [511ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [513ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [767ms] refreshing cache from master, [767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [768ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [769ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1806ms] refreshing cache from master, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1808ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5647ms] refreshing cache from master, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [5649ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [6986ms] refreshing cache from master, [6986ms] too many traces: truncated at 100 traces, deferred=Deferred@1861795443(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@30d0ec0a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.195.125:41211
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:55.082 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.082 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.082 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.082 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.083 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.083 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.095 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.096 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.096 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.096 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.096 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.098 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.107 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29689), Traces: [0ms] sending RPC to server master-127.5.195.124:40929, [3ms] received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [6ms] refreshing cache from master, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [8ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [10ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [26ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [29ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [31ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [48ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [66ms] refreshing cache from master, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [67ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [68ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [88ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [126ms] refreshing cache from master, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [129ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [129ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [226ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [229ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [229ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [266ms] refreshing cache from master, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [268ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [506ms] refreshing cache from master, [506ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [511ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [513ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [767ms] refreshing cache from master, [767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [768ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [769ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1806ms] refreshing cache from master, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1808ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5647ms] refreshing cache from master, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [5649ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [6986ms] refreshing cache from master, [6986ms] too many traces: truncated at 100 traces, deferred=Deferred@1861795443(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@30d0ec0a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29689), Traces: [0ms] sending RPC to server master-127.5.195.124:40929, [3ms] received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [6ms] refreshing cache from master, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [8ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [10ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [26ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [29ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [31ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [48ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [48ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [66ms] refreshing cache from master, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [67ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [68ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [68ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [88ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [88ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [126ms] refreshing cache from master, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [128ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [129ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [129ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [226ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [228ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [229ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [229ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [266ms] refreshing cache from master, [266ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [268ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [506ms] refreshing cache from master, [506ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [511ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [512ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [513ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [767ms] refreshing cache from master, [767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [768ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [768ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [769ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [769ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1806ms] refreshing cache from master, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1807ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1808ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1808ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5647ms] refreshing cache from master, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [5647ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [5648ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [5649ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [6986ms] refreshing cache from master, [6986ms] too many traces: truncated at 100 traces, deferred=Deferred@1861795443(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@30d0ec0a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1220574102 after retry RPC after error@1567123165) -> (continuation of Deferred@1992835109 after retry RPC after error@1095717450) -> (continuation of Deferred@169385278 after retry RPC after error@341335086) -> (continuation of Deferred@539357160 after retry RPC after error@457389220) -> (continuation of Deferred@1442626463 after retry RPC after error@51590178) -> (continuation of Deferred@205967623 after retry RPC after error@237122111) -> (continuation of Deferred@1043484711 after retry RPC after error@614121959) -> (continuation of Deferred@518972058 after retry RPC after error@21137586) -> (continuation of Deferred@761086933 after retry RPC after error@1597647456) -> (continuation of Deferred@908720431 after retry RPC after error@599515200) -> (continuation of Deferred@1681873929 after retry RPC after error@1784157124) -> (continuation of Deferred@331448097 after retry RPC after error@1862542585) -> (continuation of Deferred@1900405252 after retry RPC after error@1529416155) -> (continuation of Deferred@1124683240 after retry RPC after error@224692892) -> (continuation of Deferred@1408179446 after retry RPC after error@1083945089) -> (continuation of Deferred@1240777591 after retry RPC after error@1626177727) -> (continuation of Deferred@1263417592 after retry RPC after error@1447859880) -> (continuation of Deferred@969672813 after retry RPC after error@900243347) -> (continuation of Deferred@253491238 after retry RPC after error@1037092539) -> (continuation of Deferred@1678130700 after retry RPC after error@363032856) -> (continuation of Deferred@1160339778 after retry RPC after error@2130154050) -> (continuation of Deferred@735327694 after retry RPC after error@636598813) -> (continuation of Deferred@735902864 after retry RPC after error@1769672235) -> (continuation of Deferred@1661680783 after retry RPC after error@1258439585)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.195.125:41211
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:55.114 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
23:48:55.114 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b15b774f375318429e8c166741c1d9d) switched from state RUNNING to RESTARTING.
23:48:55.115 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
23:48:55.115 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
23:48:55.115 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.116 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.116 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.116 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.116 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.117 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.117 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.117 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.118 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.118 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.118 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.118 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:48:55.119 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
23:48:55.119 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:48:55.120 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
23:48:55.120 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
23:48:55.120 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
23:48:55.120 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
23:48:55.120 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
23:48:55.120 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
23:48:55.125 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.6.114.125:39367(127.6.114.125:39367)] disconnecting while in state TERMINATED
23:48:55.125 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.6.114.124:34801(127.6.114.124:34801)] disconnecting while in state TERMINATED
23:48:55.125 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.6.114.126:40573(127.6.114.126:40573)] disconnecting while in state TERMINATED
23:48:55.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:55.126 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
23:48:55.126 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:55.131 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:48:55.131 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
23:48:55.131 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:48:55.135 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.136 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.136 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.137 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.137 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.137 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.137 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.137 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.137 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.152 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.6.114.125:39367(127.6.114.125:39367)] disconnecting while in state TERMINATED
23:48:55.152 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.6.114.124:34801(127.6.114.124:34801)] disconnecting while in state TERMINATED
23:48:55.152 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.6.114.126:40573(127.6.114.126:40573)] disconnecting while in state TERMINATED
23:48:55.152 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:55.153 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:55.153 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:55.156 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.156 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.156 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.157 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.165 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:48:55.165 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
23:48:55.165 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:48:55.176 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.6.114.125:39367(127.6.114.125:39367)] disconnecting while in state TERMINATED
23:48:55.176 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.6.114.124:34801(127.6.114.124:34801)] disconnecting while in state TERMINATED
23:48:55.176 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.6.114.126:40573(127.6.114.126:40573)] disconnecting while in state TERMINATED
23:48:55.176 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 1228d72bb77941ef982d60ce38a833cf(127.6.114.65:39287)] disconnecting while in state TERMINATED
23:48:55.176 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.176 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.177 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.177 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:55.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.179 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
23:48:55.179 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
23:48:55.179 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:55.187 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:48:55.187 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
23:48:55.187 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:48:55.195 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.6.114.125:39367(127.6.114.125:39367)] disconnecting while in state TERMINATED
23:48:55.196 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.6.114.124:34801(127.6.114.124:34801)] disconnecting while in state TERMINATED
23:48:55.196 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.6.114.126:40573(127.6.114.126:40573)] disconnecting while in state TERMINATED
23:48:55.196 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:55.197 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
23:48:55.197 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:55.197 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
23:48:55.197 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:48:55.199 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:48:55.199 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
23:48:55.208 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:48:55.211 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
23:48:55.212 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
23:48:55.213 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:55.220 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:55.220 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:48:55.220 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
23:48:55.220 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:48:55.221 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
23:48:55.222 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
23:48:55.223 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:48:55.225 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:55.227 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
23:48:55.228 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:55.228 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
23:48:55.228 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:48:55.229 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:48:55.230 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
23:48:55.231 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:48:55.234 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:48:55.236 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.236 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.236 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.237 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.237 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.238 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.238 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.238 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.239 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.239 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.239 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.239 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.251 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:48:55.251 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
23:48:55.252 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
23:48:55.252 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:48:55.253 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
23:48:55.253 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
23:48:55.255 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b15b774f375318429e8c166741c1d9d
23:48:55.272 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:48:55.291 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:48:55.314 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:48:55.315 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.316 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.316 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.317 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.317 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.317 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.317 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.317 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.321 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:48:55.323 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:48:55.323 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:48:55.324 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:48:55.324 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:48:55.324 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:48:55.324 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:48:55.325 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:55.325 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:55.326 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:55.326 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:55.326 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:55.326 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:55.326 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:48:55.326 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:48:55.326 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:48:55.326 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:48:55.326 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:48:55.327 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:48:55.327 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:48:55.327 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:48:55.328 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:48:55.328 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:48:55.328 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:48:55.328 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_ba5fbf788c1e5f406d6611ddd43ec32d/blobStorage
23:48:55.328 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:45303 - max concurrent requests: 50 - max backlog: 1000
23:48:55.329 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_ba5fbf788c1e5f406d6611ddd43ec32d/blobStorage
23:48:55.331 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_ba5fbf788c1e5f406d6611ddd43ec32d/blobStorage
23:48:55.333 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:48:55.333 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: ede5d2ba-0d1b-4601-ac64-b35863f2b4b5
23:48:55.335 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:48:55.336 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-fd09dfc6-c16b-4eaf-af6c-e4f0472be81c
23:48:55.339 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-33af6ee1-32b9-4a2c-a815-ef41f0bc3c80
23:48:55.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468135369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:55.387 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
23:48:55.388 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
23:48:55.404 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:48:55.405 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:48:55.405 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:48:55.405 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:48:55.406 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:48:55.408 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_16 .
23:48:55.414 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
23:48:55.414 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-68e25cbf-b231-4c48-9480-cc9673db0d78
23:48:55.415 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:48:55.415 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:48:55.424 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:48:55.425 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:48:55.430 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:45629
23:48:55.430 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:48:55.431 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:45629 was granted leadership with leaderSessionID=3900073c-6bb8-4351-93ec-7c869458e5e4
23:48:55.431 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:45629 , session=3900073c-6bb8-4351-93ec-7c869458e5e4
23:48:55.432 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:48:55.432 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:48:55.433 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:48:55.433 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id ec805eaf-137f-45f1-9362-bdd87f2abfc8. Creating new DispatcherLeaderProcess.
23:48:55.433 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:48:55.433 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:48:55.434 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:48:55.434 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:48:55.436 [INFO - pool-183-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 4bbb5ea0-2f62-49ab-b6d7-a5c1be539e08.
23:48:55.446 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_17 .
23:48:55.452 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_17 , session=ec805eaf-137f-45f1-9362-bdd87f2abfc8
23:48:55.453 [INFO - pool-183-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_18 .
23:48:55.474 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
23:48:55.475 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:48:55.475 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:48:55.475 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:48:55.475 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:48:55.476 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_18 , session=4bbb5ea0-2f62-49ab-b6d7-a5c1be539e08
23:48:55.483 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_18(b6d7a5c1be539e084bbb5ea02f6249ab).
23:48:55.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:55.495 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.496 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.496 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.496 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.496 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.496 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.496 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.496 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.497 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.497 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.497 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:55.498 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:55.501 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (c4b00a34e6633561fb08795709e8dcd8).
23:48:55.501 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (c4b00a34e6633561fb08795709e8dcd8).
23:48:55.502 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-c4b00a34e6633561fb08795709e8dcd8'.
23:48:55.502 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job c4b00a34e6633561fb08795709e8dcd8 was granted leadership with leader id 8016256a-1499-4716-9223-045c5111c1c9. Creating new JobMasterServiceProcess.
23:48:55.507 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 (pekko://flink/user/rpc/taskmanager_16) at ResourceManager
23:48:55.509 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_18 under registration id 6742e93a701e33a8fda3b79b40a8ce6b.
23:48:55.509 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 under 6742e93a701e33a8fda3b79b40a8ce6b at the slot manager.
23:48:55.517 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_19 .
23:48:55.522 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (c4b00a34e6633561fb08795709e8dcd8).
23:48:55.523 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (c4b00a34e6633561fb08795709e8dcd8).
23:48:55.524 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph a47ffb62f668cc7507ba254065e63851 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.524 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (c4b00a34e6633561fb08795709e8dcd8).
23:48:55.524 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:48:55.526 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
23:48:55.526 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d4d7484
23:48:55.526 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:55.526 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:48:55.527 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:48:55.528 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@4524ca25 for Flink Streaming Job (c4b00a34e6633561fb08795709e8dcd8).
23:48:55.528 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_19 , session=8016256a-1499-4716-9223-045c5111c1c9
23:48:55.530 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (c4b00a34e6633561fb08795709e8dcd8) under job master id 9223045c5111c1c98016256a14994716.
23:48:55.531 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:48:55.533 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.535 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:48:55.535 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c4b00a34e6633561fb08795709e8dcd8) switched from state CREATED to RUNNING.
23:48:55.536 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:48:55.537 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:48:55.537 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:48:55.538 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:48:55.538 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_18(b6d7a5c1be539e084bbb5ea02f6249ab)
23:48:55.540 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:48:55.540 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:390) Registering job manager 9223045c5111c1c98016256a14994716@pekko://flink/user/rpc/jobmanager_19 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.547 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1015) Registered job manager 9223045c5111c1c98016256a14994716@pekko://flink/user/rpc/jobmanager_19 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.554 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b6d7a5c1be539e084bbb5ea02f6249ab.
23:48:55.555 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:55.555 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:48:55.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:55.559 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:55.559 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:55.560 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.73.189:33103(127.9.73.189:33103)] Successfully connected to peer
23:48:55.572 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.73.190:40177(127.9.73.190:40177)] Successfully connected to peer
23:48:55.575 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job c4b00a34e6633561fb08795709e8dcd8
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager ede5d2ba-0d1b-4601-ac64-b35863f2b4b5
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:48:55.576 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d22e0e336504f89f4dee7648ad4e716f from ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 for job c4b00a34e6633561fb08795709e8dcd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.577 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot c173001062ddee40ff21366b0827dffd from ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 for job c4b00a34e6633561fb08795709e8dcd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.577 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request d22e0e336504f89f4dee7648ad4e716f for job c4b00a34e6633561fb08795709e8dcd8 from resource manager with leader id b6d7a5c1be539e084bbb5ea02f6249ab.
23:48:55.577 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for d22e0e336504f89f4dee7648ad4e716f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.577 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 217be37037a0ec46e05638b03f7dedae from ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 for job c4b00a34e6633561fb08795709e8dcd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.578 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f9be20d5fda284e3ee0400cc3a3209bc from ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 for job c4b00a34e6633561fb08795709e8dcd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.583 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.190
23:48:55.583 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.73.188:35043(127.9.73.188:35043)] Successfully connected to peer
23:48:55.590 [DEBUG - main] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:48:55.593 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.595 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.189
23:48:55.597 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.188
23:48:55.599 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job c4b00a34e6633561fb08795709e8dcd8 for job leader monitoring.
23:48:55.600 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_19 with leader id 8016256a-1499-4716-9223-045c5111c1c9.
23:48:55.600 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request c173001062ddee40ff21366b0827dffd for job c4b00a34e6633561fb08795709e8dcd8 from resource manager with leader id b6d7a5c1be539e084bbb5ea02f6249ab.
23:48:55.600 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for c173001062ddee40ff21366b0827dffd with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.600 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 217be37037a0ec46e05638b03f7dedae for job c4b00a34e6633561fb08795709e8dcd8 from resource manager with leader id b6d7a5c1be539e084bbb5ea02f6249ab.
23:48:55.601 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 217be37037a0ec46e05638b03f7dedae with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.601 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request f9be20d5fda284e3ee0400cc3a3209bc for job c4b00a34e6633561fb08795709e8dcd8 from resource manager with leader id b6d7a5c1be539e084bbb5ea02f6249ab.
23:48:55.601 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for f9be20d5fda284e3ee0400cc3a3209bc with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:48:55.602 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:48:55.606 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:55.606 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:55.606 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:55.606 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:55.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:55.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:55.607 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:55.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:55.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:55.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:55.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:55.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:55.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:55.611 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_19 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.611 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1783) Establish JobManager connection for job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.611 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1633) Offer reserved slots to the leader of job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.612 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:48:55.612 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id 217be37037a0ec46e05638b03f7dedae
23:48:55.614 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 217be37037a0ec46e05638b03f7dedae.
23:48:55.614 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.615 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job c4b00a34e6633561fb08795709e8dcd8.
23:48:55.616 [INFO - flink-pekko.actor.default-dispatcher-7] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:48:55.616 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id c4b00a34e6633561fb08795709e8dcd8
23:48:55.617 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 217be37037a0ec46e05638b03f7dedae.
23:48:55.619 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.621 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043] using SASL/PLAIN
23:48:55.621 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103] using SASL/PLAIN
23:48:55.624 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3cb146c0, L:/127.0.0.1:56780 - R:/127.9.73.190:40177] using SASL/PLAIN
23:48:55.627 [DEBUG - main] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:48:55.628 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:55.628 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=76), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [69ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [72ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: OK, deferred=null) after lookup
23:48:55.628 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.61:36251(127.9.248.61:36251)] Successfully connected to peer
23:48:55.632 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.61
23:48:55.632 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:55.635 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:48:55.635 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id d22e0e336504f89f4dee7648ad4e716f
23:48:55.635 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 14a063200fb74afa9665736f005dd7fe for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:55.635 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8cf762a7433f4690bd8243d3ae223cfe for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:55.635 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d946712f74c14c10a3a819b2b5fbdea4 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:55.636 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=14a063200fb74afa9665736f005dd7fe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)[L],a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=8cf762a7433f4690bd8243d3ae223cfe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=d946712f74c14c10a3a819b2b5fbdea4@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}]
23:48:55.638 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d22e0e336504f89f4dee7648ad4e716f.
23:48:55.639 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id d22e0e336504f89f4dee7648ad4e716f.
23:48:55.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:48:55.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:48:55.644 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f81589
23:48:55.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:55.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:48:55.647 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x98c63627, L:/127.0.0.1:49236 - R:/127.9.248.61:36251] using SASL/PLAIN
23:48:55.649 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:55.650 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:48:55.650 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:48:55.650 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e2df9b0
23:48:55.650 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:55.651 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:48:55.653 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:55.659 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b628799
23:48:55.662 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.663 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28e11862
23:48:55.665 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.667 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:48:55.667 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id f9be20d5fda284e3ee0400cc3a3209bc
23:48:55.668 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f9be20d5fda284e3ee0400cc3a3209bc.
23:48:55.668 [DEBUG - main] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:48:55.669 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id f9be20d5fda284e3ee0400cc3a3209bc.
23:48:55.677 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.60:35483(127.9.248.60:35483)] Successfully connected to peer
23:48:55.683 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.62:39393(127.9.248.62:39393)] Successfully connected to peer
23:48:55.684 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.60
23:48:55.686 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.62
23:48:55.689 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:48:55.695 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:48:55.695 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id c173001062ddee40ff21366b0827dffd
23:48:55.696 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:48:55.696 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:48:55.698 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.701 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa2f58775, L:/127.0.0.1:42514 - R:/127.9.248.60:35483] using SASL/PLAIN
23:48:55.704 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:55.704 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=140), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.61:36251, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.60:35483, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.61:36251: OK, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.62:39393, [113ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.60:35483: OK, deferred=null) after lookup
23:48:55.707 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.707 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c173001062ddee40ff21366b0827dffd.
23:48:55.709 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id c173001062ddee40ff21366b0827dffd.
23:48:55.710 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.713 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9e486684, L:/127.0.0.1:59254 - R:/127.9.248.62:39393] using SASL/PLAIN
23:48:55.713 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 31304b7d60d54d1ab082807886eef61c for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:55.713 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 7299f299e13343548f3341a23e5a0ee0 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:55.714 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:55.714 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=31304b7d60d54d1ab082807886eef61c@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7299f299e13343548f3341a23e5a0ee0@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803),783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)[L],7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}]
23:48:55.714 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:48:55.714 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:48:55.714 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.60:35483, [6ms] Sub RPC GetTableLocations: received response from server master-127.9.248.60:35483: OK, deferred=null)) after lookup
23:48:55.714 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] connecting to peer
23:48:55.715 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@775b6b24
23:48:55.715 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:55.715 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:48:55.715 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:55.715 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:48:55.716 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:48:55.716 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 217be37037a0ec46e05638b03f7dedae.
23:48:55.716 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot d22e0e336504f89f4dee7648ad4e716f.
23:48:55.716 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:48:55.717 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f9be20d5fda284e3ee0400cc3a3209bc.
23:48:55.717 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c173001062ddee40ff21366b0827dffd.
23:48:55.717 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:48:55.717 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:48:55.717 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:48:55.718 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.61:36251(127.9.248.61:36251)] Successfully connected to peer
23:48:55.718 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.61:36251(127.9.248.61:36251)] Successfully connected to peer
23:48:55.719 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:48:55.720 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.61
23:48:55.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:55.722 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5fbb324e
23:48:55.724 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.727 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.60:35483(127.9.248.60:35483)] Successfully connected to peer
23:48:55.729 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.60
23:48:55.733 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.62:39393(127.9.248.62:39393)] Successfully connected to peer
23:48:55.733 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@126cf929
23:48:55.733 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:55.734 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:48:55.734 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:55.734 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:48:55.746 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.61
23:48:55.747 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63720f0a
23:48:55.750 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.751 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.62
23:48:55.755 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.756 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.759 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x013b794d, L:/127.0.0.1:49254 - R:/127.9.248.61:36251] using SASL/PLAIN
23:48:55.760 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc47aee87, L:/127.0.0.1:49242 - R:/127.9.248.61:36251] using SASL/PLAIN
23:48:55.767 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:48:55.769 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.774 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.769 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.60:35483(127.9.248.60:35483)] Successfully connected to peer
23:48:55.780 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xfd1516c4, L:/127.0.0.1:42526 - R:/127.9.248.60:35483] using SASL/PLAIN
23:48:55.782 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6c4250eb, L:/127.0.0.1:59260 - R:/127.9.248.62:39393] using SASL/PLAIN
23:48:55.782 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.60
23:48:55.785 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:55.786 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=123), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.61:36251, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.60:35483, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.62:39393, [47ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.61:36251: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.62:39393: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.60:35483: OK, deferred=null) after lookup
23:48:55.791 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.62:39393(127.9.248.62:39393)] Successfully connected to peer
23:48:55.793 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] Successfully connected to peer
23:48:55.793 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.798 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.62
23:48:55.799 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.799 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f884c28
23:48:55.799 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:48:55.801 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:48:55.801 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:48:55.808 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:48:55.816 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.818 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.818 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.819 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:48:55.820 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:48:55.820 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.61:36251(127.9.248.61:36251)] Successfully connected to peer
23:48:55.821 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.61
23:48:55.821 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.61:36251(127.9.248.61:36251)] Successfully connected to peer
23:48:55.823 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x3c8aa003, L:/127.0.0.1:54356 - R:/127.9.248.2:38803] using TOKEN/null
23:48:55.824 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.61
23:48:55.826 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc59dacdd, L:/127.0.0.1:42534 - R:/127.9.248.60:35483] using SASL/PLAIN
23:48:55.828 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.830 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:55.831 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.61:36251, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.60:35483, [74ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.61:36251: OK, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.62:39393, [140ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.60:35483: OK, deferred=null) after lookup
23:48:55.833 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf5aff696, L:/127.0.0.1:59264 - R:/127.9.248.62:39393] using SASL/PLAIN
23:48:55.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.838 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.838 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b603845
23:48:55.839 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6de53941, L:/127.0.0.1:49256 - R:/127.9.248.61:36251] using SASL/PLAIN
23:48:55.840 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:48:55.840 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:48:55.849 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.851 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x62aea163, L:/127.0.0.1:49272 - R:/127.9.248.61:36251] using SASL/PLAIN
23:48:55.859 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:55.860 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='223e79a36a54556c2c4a96d54541bb2ec456a0334804bbbe9cbf2684230787a9'}]
23:48:55.862 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.862 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:48:55.864 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:55.864 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:55.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:55.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:55.869 [DEBUG - main] (Connection.java:748) [peer 783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)] connecting to peer
23:48:55.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468135869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:55.880 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:55.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
23:48:55.884 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:48:55.886 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.60:35483(127.9.248.60:35483)] Successfully connected to peer
23:48:55.893 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.62:39393(127.9.248.62:39393)] Successfully connected to peer
23:48:55.895 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.60
23:48:55.896 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:48:55.897 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.60:35483(127.9.248.60:35483)] Successfully connected to peer
23:48:55.898 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.62
23:48:55.903 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.62:39393(127.9.248.62:39393)] Successfully connected to peer
23:48:55.908 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.60
23:48:55.913 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.248.62
23:48:55.916 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.918 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.920 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7c056d59, L:/127.0.0.1:42562 - R:/127.9.248.60:35483] using SASL/PLAIN
23:48:55.924 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.925 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe576079c, L:/127.0.0.1:42546 - R:/127.9.248.60:35483] using SASL/PLAIN
23:48:55.928 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.928 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9741da9a, L:/127.0.0.1:59268 - R:/127.9.248.62:39393] using SASL/PLAIN
23:48:55.931 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:55.931 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)] Successfully connected to peer
23:48:55.931 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2f488e64, L:/127.0.0.1:59272 - R:/127.9.248.62:39393] using SASL/PLAIN
23:48:55.933 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:48:55.933 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.61:36251, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.60:35483, [54ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.61:36251: OK, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.62:39393, [131ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.60:35483: OK, deferred=null) after lookup
23:48:55.933 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=208), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.61:36251, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.60:35483, [37ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.61:36251: OK, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.62:39393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.60:35483: OK, [123ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.62:39393: OK, deferred=null) after lookup
23:48:55.935 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:55.935 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.935 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='30595bb0aff903cb6df8b3e1a2c45237e7f34544e459733fe505d7e1dc043465'}]
23:48:55.937 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.940 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.941 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@31c2244f
23:48:55.942 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.943 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:55.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299998, tablet=14a063200fb74afa9665736f005dd7fe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}]
23:48:55.944 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:55.944 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49501a04
23:48:55.946 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:55.950 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x0ce2b25c, L:/127.0.0.1:52258 - R:/127.9.248.1:35283] using TOKEN/null
23:48:55.951 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:55.952 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=8cf762a7433f4690bd8243d3ae223cfe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785)[L],a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}]
23:48:55.959 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:55.968 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:55.978 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:55.982 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:55.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:55.988 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:48:55.989 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:48:55.989 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:48:55.990 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:48:55.990 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:48:55.992 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:48:55.993 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:48:55.994 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='93c2694c6b6796c0db026428c2ee56a133401bc0acc9409e46436cfa199365d0'}]
23:48:55.996 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:55.997 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:55.997 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:55.997 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:55.997 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.997 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:55.998 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.998 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.998 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.998 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.998 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:55.998 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:55.998 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.013 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.020 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:56.022 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.023 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.024 [DEBUG - kudu-nio-0] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:56.026 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.029 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:56.036 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.129
23:48:56.043 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998, tablet=d946712f74c14c10a3a819b2b5fbdea4@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785)[L],a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}]
23:48:56.044 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:56.044 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:56.045 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:56.045 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:56.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:56.045 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:56.045 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:56.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:56.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:56.046 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:56.046 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:56.046 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:56.046 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:56.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468136057 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:56.058 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:56.070 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x62869eb1, L:/127.0.0.1:60232 - R:/127.9.73.129:34153] using SASL/PLAIN
23:48:56.079 [DEBUG - kudu-nio-0] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:56.081 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.081 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.085 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.129
23:48:56.087 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:56.088 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.088 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.091 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.094 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false, responseScanTimestamp = 7305085483216896001) for scanner KuduScanner(table=replication_test_table, tablet=14a063200fb74afa9665736f005dd7fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.095 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [223e79a36a54556c2c4a96d54541bb2ec456a0334804bbbe9cbf2684230787a9]
23:48:56.095 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:48:56.102 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:56.103 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:56.103 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:56.103 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:56.104 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:56.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:56.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:56.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:56.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:56.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:56.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:56.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:56.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:56.104 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:56.108 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 31304b7d60d54d1ab082807886eef61c for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:56.109 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 7299f299e13343548f3341a23e5a0ee0 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:56.109 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:56.110 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299998, tablet=31304b7d60d54d1ab082807886eef61c@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=7299f299e13343548f3341a23e5a0ee0@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803),783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)[L],7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}]
23:48:56.114 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xae87dcf5, L:/127.0.0.1:60242 - R:/127.9.73.129:34153] using SASL/PLAIN
23:48:56.115 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 31304b7d60d54d1ab082807886eef61c for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:56.115 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 7299f299e13343548f3341a23e5a0ee0 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:56.115 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:56.115 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=31304b7d60d54d1ab082807886eef61c@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7299f299e13343548f3341a23e5a0ee0@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803),783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)[L],7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}]
23:48:56.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 31304b7d60d54d1ab082807886eef61c for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:56.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 7299f299e13343548f3341a23e5a0ee0 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:56.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:56.116 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=31304b7d60d54d1ab082807886eef61c@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7299f299e13343548f3341a23e5a0ee0@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803),783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)[L],7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}]
23:48:56.118 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [223e79a36a54556c2c4a96d54541bb2ec456a0334804bbbe9cbf2684230787a9]
23:48:56.118 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 31304b7d60d54d1ab082807886eef61c for table 'replication_test_table' with partition [<start>, 0x80000064)
23:48:56.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 7299f299e13343548f3341a23e5a0ee0 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
23:48:56.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3dcdfcdfd6d94f1a948e22bca1e8e917 for table 'replication_test_table' with partition [0x800000C8, <end>)
23:48:56.119 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=31304b7d60d54d1ab082807886eef61c@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7299f299e13343548f3341a23e5a0ee0@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)[L],783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283),7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917@[0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803),783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)[L],7a147bd31ba747b29bca1dbfb99edafa(127.9.248.3:36277)]}]
23:48:56.120 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 223e79a36a54556c2c4a96d54541bb2ec456a0334804bbbe9cbf2684230787a9 finished by subtask 1; deferring removal (restored in pending)
23:48:56.120 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:56.120 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:56.120 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:56.121 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:56.122 [DEBUG - kudu-nio-0] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:56.123 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.129
23:48:56.126 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085483216896001) for scanner KuduScanner(table=replication_test_table, tablet=8cf762a7433f4690bd8243d3ae223cfe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.126 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [30595bb0aff903cb6df8b3e1a2c45237e7f34544e459733fe505d7e1dc043465]
23:48:56.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [30595bb0aff903cb6df8b3e1a2c45237e7f34544e459733fe505d7e1dc043465]
23:48:56.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:56.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:56.127 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:56.128 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 30595bb0aff903cb6df8b3e1a2c45237e7f34544e459733fe505d7e1dc043465 finished by subtask 0; deferring removal (restored in pending)
23:48:56.129 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:56.129 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job c4b00a34e6633561fb08795709e8dcd8 (2859 bytes, checkpointDuration=72 ms, finalizationTime=0 ms).
23:48:56.130 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:48:56.131 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b15b774f375318429e8c166741c1d9d) switched from state RESTARTING to RUNNING.
23:48:56.131 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 223e79a36a54556c2c4a96d54541bb2ec456a0334804bbbe9cbf2684230787a9 from pending
23:48:56.131 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 30595bb0aff903cb6df8b3e1a2c45237e7f34544e459733fe505d7e1dc043465 from pending
23:48:56.131 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 2 finished splits from enumerator state
23:48:56.131 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 6b15b774f375318429e8c166741c1d9d from Checkpoint 67 @ 1783468134902 for 6b15b774f375318429e8c166741c1d9d located at file:/tmp/junit15317314641945509700/checkpoints/6b15b774f375318429e8c166741c1d9d/chk-67.
23:48:56.132 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
23:48:56.133 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
23:48:56.141 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:56.143 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x28c6c48a, L:/127.0.0.1:60250 - R:/127.9.73.129:34153] using SASL/PLAIN
23:48:56.146 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.147 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.151 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085483216896001) for scanner KuduScanner(table=replication_test_table, tablet=d946712f74c14c10a3a819b2b5fbdea4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.151 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [93c2694c6b6796c0db026428c2ee56a133401bc0acc9409e46436cfa199365d0]
23:48:56.151 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [93c2694c6b6796c0db026428c2ee56a133401bc0acc9409e46436cfa199365d0]
23:48:56.152 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:56.152 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:56.153 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 93c2694c6b6796c0db026428c2ee56a133401bc0acc9409e46436cfa199365d0 finished by subtask 3; deferring removal (restored in pending)
23:48:56.153 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:56.154 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:56.154 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.154 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.158 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.179 [DEBUG - kudu-nio-0] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:56.179 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:56.180 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:48:56.180 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:56.193 [INFO - Thread-40] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
23:48:56.193 [DEBUG - Thread-40] (Connection.java:575) [peer master-127.5.195.124:40929(127.5.195.124:40929)] disconnecting while in state TERMINATED
23:48:56.194 [DEBUG - Thread-40] (Connection.java:575) [peer master-127.5.195.126:36941(127.5.195.126:36941)] disconnecting while in state TERMINATED
23:48:56.194 [DEBUG - Thread-40] (Connection.java:575) [peer master-127.5.195.125:41211(127.5.195.125:41211)] disconnecting while in state TERMINATED
23:48:56.194 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:56.196 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
23:48:56.196 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
23:48:56.196 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:48:56.198 [INFO - Thread-40] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
23:48:56.206 [DEBUG - kudu-nio-0] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:56.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:56.206 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:48:56.206 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:56.211 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
23:48:56.213 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:56.214 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:48:56.220 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.220 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:56.228 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
23:48:56.229 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
23:48:56.229 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id a857b45a30f1252b1fcc0c16c9bf115a
23:48:56.229 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.229 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
23:48:56.230 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.230 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
23:48:56.230 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 7b1f70b00c2a8ee4ccf39cae7c72c607
23:48:56.231 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:48:56.231 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:48:56.232 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot a857b45a30f1252b1fcc0c16c9bf115a.
23:48:56.233 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id a857b45a30f1252b1fcc0c16c9bf115a.
23:48:56.233 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
23:48:56.234 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.234 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:48:56.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
23:48:56.235 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 532cad1ce9bc484a8df8730b4379ae15
23:48:56.236 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
23:48:56.236 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:48:56.237 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
23:48:56.237 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 689d84fe30510664cb4c992d23e6dc0a
23:48:56.237 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:48:56.238 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:48:56.238 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:48:56.238 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:48:56.243 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:48:56.245 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:48:56.245 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
23:48:56.245 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
23:48:56.248 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:56.248 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:56.248 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:56.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:56.249 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:56.249 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:56.249 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:56.249 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:56.249 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1082fa5
23:48:56.249 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:56.249 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:56.249 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:56.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:56.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:56.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:56.249 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:56.249 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:48:56.250 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:48:56.257 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@24217bd9
23:48:56.260 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:56.263 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 532cad1ce9bc484a8df8730b4379ae15.
23:48:56.264 [DEBUG - kudu-nio-0] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:56.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:56.264 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:56.264 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:56.264 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 532cad1ce9bc484a8df8730b4379ae15.
23:48:56.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
23:48:56.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
23:48:56.266 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ea26aae
23:48:56.266 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:56.266 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:56.266 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:48:56.266 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:48:56.268 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17cf8c04
23:48:56.270 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:56.271 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.282 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.294 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 689d84fe30510664cb4c992d23e6dc0a.
23:48:56.295 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.295 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 689d84fe30510664cb4c992d23e6dc0a.
23:48:56.296 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
23:48:56.296 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
23:48:56.297 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2609bac7
23:48:56.297 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:56.297 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:56.297 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:48:56.298 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:48:56.304 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.305 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.313 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.313 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.315 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
23:48:56.316 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
23:48:56.316 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37fa0e53
23:48:56.316 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:48:56.317 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:48:56.318 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:48:56.318 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.318 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:48:56.315 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@75b3d0ba
23:48:56.325 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.327 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@54db415e
23:48:56.328 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.328 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:56.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.332 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:56.339 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.340 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.340 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.343 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.345 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.345 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.349 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.349 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.356 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.367 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.375 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.375 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.376 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468136369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:56.383 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.383 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.384 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:48:56.385 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
23:48:56.388 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.396 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.397 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.397 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.397 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.403 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.404 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.411 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.415 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.416 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.427 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.428 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.428 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.428 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.429 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.429 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.430 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.435 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.436 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.437 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.441 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.442 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.445 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.446 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.446 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.447 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.448 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.448 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.449 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.450 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.450 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.454 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.456 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.475 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.476 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.477 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.477 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.477 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.479 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.480 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.481 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.481 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:56.485 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.485 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.485 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.485 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.494 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.494 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.494 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.494 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.496 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.503 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.506 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.509 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.509 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.509 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.510 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.510 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:56.511 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.512 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.513 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.513 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.516 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.519 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.520 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.520 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.520 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.520 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.521 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.521 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.521 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.528 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.528 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.528 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.528 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.528 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.529 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.529 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.529 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.534 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.535 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.536 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.536 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.536 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.536 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.536 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.536 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.537 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.542 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.542 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.543 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.547 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.551 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.552 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.552 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.553 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.553 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.553 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.553 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.554 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.554 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.554 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.554 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.554 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.554 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.554 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.554 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.554 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.555 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.555 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.555 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.556 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.556 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.556 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.556 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.556 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.556 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.556 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.557 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.557 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.558 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.558 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.558 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468136557 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:56.559 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.559 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.559 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.559 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.559 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.560 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.561 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.561 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=15, operationSize=950, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2b81c2ac, flushNotification=Deferred@1489201547(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:48:56.562 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.562 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.562 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] connecting to peer
23:48:56.562 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.562 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.563 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.563 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.563 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.564 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.565 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.565 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.565 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.565 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.567 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] Successfully connected to peer
23:48:56.568 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.572 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.572 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.572 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.573 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.573 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.573 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.573 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.573 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.574 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.574 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.574 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.574 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.574 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.574 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.574 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.575 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.576 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.576 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.576 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.576 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.576 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.576 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.576 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.576 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.577 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.577 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.577 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.577 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.579 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.579 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.579 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.583 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.583 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.584 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.584 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.584 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.585 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.585 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.589 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.589 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.589 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.591 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.592 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.592 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.592 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.592 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.592 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.592 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.592 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.592 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.592 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.595 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.595 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.595 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.595 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.596 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.596 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.596 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.596 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.596 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.596 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.597 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.597 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.597 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.598 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.598 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.598 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.598 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.598 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.598 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.598 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.627 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.628 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.628 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.628 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.629 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.629 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.630 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.630 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.630 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.630 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.630 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.627 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.631 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.631 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.631 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.631 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.631 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.631 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.631 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.631 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.631 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.631 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.631 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.632 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.632 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.632 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.632 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.632 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.632 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.633 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.633 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.633 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.633 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.633 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.633 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.633 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.639 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.639 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:56.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.640 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.640 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.640 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.642 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x180422e1, L:/127.0.0.1:54362 - R:/127.9.248.2:38803] using TOKEN/null
23:48:56.642 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.642 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.642 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.642 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.643 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.649 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.655 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.655 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.656 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.657 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.657 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.658 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.669 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.669 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.669 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.670 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.670 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.672 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.676 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.677 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.677 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.677 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.677 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.677 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.677 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.677 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.677 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.678 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.678 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.678 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.678 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.684 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.684 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.685 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.686 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.686 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.686 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.686 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.687 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.688 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.689 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.689 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.689 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.689 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.689 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.704 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.705 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.705 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.706 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.707 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.707 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.707 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.707 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.707 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job c4b00a34e6633561fb08795709e8dcd8 (1593 bytes, checkpointDuration=149 ms, finalizationTime=1 ms).
23:48:56.710 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:48:56.710 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 93c2694c6b6796c0db026428c2ee56a133401bc0acc9409e46436cfa199365d0 from pending
23:48:56.710 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 1 finished splits from enumerator state
23:48:56.711 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.711 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.712 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.712 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.713 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.713 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.713 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.713 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.714 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.717 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.717 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:56.722 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.726 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:56.729 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:56.732 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:56.733 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.733 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.733 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.734 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.734 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.734 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.734 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.734 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.734 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.734 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.734 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.739 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:56.750 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:56.766 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8d4e3cc5537d45f2ba7e14cf9108cf20
23:48:56.767 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.768 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.768 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.769 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.769 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.769 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.769 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.769 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.770 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.770 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.770 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.770 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.780 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=14a063200fb74afa9665736f005dd7fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.780 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 14a063200fb74afa9665736f005dd7fe for partition [<start>, 0x80000064) with scanner id null
23:48:56.781 [DEBUG - main] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:56.783 [DEBUG - kudu-nio-4] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:56.796 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.796 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.796 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.798 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.798 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.798 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.798 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.798 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.813 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:56.816 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.816 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.816 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.816 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.816 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.816 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.817 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.817 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.817 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.817 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.820 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x05e372b7, L:/127.0.0.1:60264 - R:/127.9.73.129:34153] using TOKEN/null
23:48:56.824 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8cf762a7433f4690bd8243d3ae223cfe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.824 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 8cf762a7433f4690bd8243d3ae223cfe for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.829 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.829 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.829 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.829 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.831 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d946712f74c14c10a3a819b2b5fbdea4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.836 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.837 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.840 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.841 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.845 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.852 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=14a063200fb74afa9665736f005dd7fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.852 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.852 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 14a063200fb74afa9665736f005dd7fe for partition [<start>, 0x80000064) with scanner id null
23:48:56.852 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.852 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.853 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.853 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.853 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.853 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.853 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.853 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.853 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.853 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.855 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:56.855 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:56.855 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:56.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.856 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:56.858 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.858 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:56.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:56.859 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:56.860 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8cf762a7433f4690bd8243d3ae223cfe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.860 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 8cf762a7433f4690bd8243d3ae223cfe for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.864 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d946712f74c14c10a3a819b2b5fbdea4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468136869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:56.880 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:56.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
23:48:56.881 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=31304b7d60d54d1ab082807886eef61c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.881 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 31304b7d60d54d1ab082807886eef61c for partition [<start>, 0x80000064) with scanner id null
23:48:56.887 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7299f299e13343548f3341a23e5a0ee0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.887 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7299f299e13343548f3341a23e5a0ee0 for partition [0x80000064, 0x800000C8) with scanner id null
23:48:56.903 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3dcdfcdfd6d94f1a948e22bca1e8e917, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:56.904 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.61:36251(127.9.248.61:36251)] disconnecting while in state READY
23:48:56.904 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.62:39393(127.9.248.62:39393)] disconnecting while in state READY
23:48:56.904 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.60:35483(127.9.248.60:35483)] disconnecting while in state READY
23:48:56.904 [DEBUG - main] (Connection.java:575) [peer 783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)] disconnecting while in state READY
23:48:56.904 [DEBUG - main] (Connection.java:575) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] disconnecting while in state READY
23:48:56.904 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.62:39393(127.9.248.62:39393)] handling channelInactive
23:48:56.904 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.61:36251(127.9.248.61:36251)] handling channelInactive
23:48:56.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state READY due to: connection closed
23:48:56.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state READY due to: connection closed
23:48:56.904 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.60:35483(127.9.248.60:35483)] handling channelInactive
23:48:56.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state READY due to: connection closed
23:48:56.905 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)] handling channelInactive
23:48:56.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 783d9938b0e042a59f828e194dbbd5fc(127.9.248.1:35283)] cleaning up while in state READY due to: connection closed
23:48:56.907 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:56.909 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:56.909 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
23:48:56.909 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:48:56.910 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
23:48:56.910 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] handling channelInactive
23:48:56.910 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] cleaning up while in state READY due to: connection closed
23:48:56.910 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
23:48:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:56.911521 10208 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10490
23:48:56.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:56.956190 10613 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:56.963 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:56.963 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:56.964 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:56.964 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.964 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.964 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:56.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:56.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:56.965 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:56.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:57.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:57.011 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.012 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.012 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.012 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.012 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.013 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.013 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.013 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.013 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.013 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.013 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.013 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468137057 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:57.063 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:57.063 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:57.063 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:57.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.064 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.064 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.064 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.064 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.065 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.065 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.065 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:57.067 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.068 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.068 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.069 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.069 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.069 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.070 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
23:48:57.073 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:48:57.075 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.075 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.076 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.076 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.115 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.115 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.116 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.118 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.118 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.118 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.176 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.176 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.176 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.177 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.177 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.177 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.178 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.178 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.178 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.178 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.178 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.178 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.189 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.189 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.189 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.190 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.190 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.190 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.190 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.190 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.190 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:57.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:57.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:57.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:57.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.302 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.302 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:57.363 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:57.363 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:57.364 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:57.364 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.364 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.366 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.366 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.366 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:57.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468137369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:57.372 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.372 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.372 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.373 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.373 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.373 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.374 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.374 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.374 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.374 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.374 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.375 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.377 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:57.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
23:48:57.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:57.396279 10208 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10490
23:48:57.402 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:57.403 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:57.403 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:57.403 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:57.403 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:57.403 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:57.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:57.404 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:57.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:57.404 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:57.404 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:57.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:57.404 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:57.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:57.452117 10644 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.248.1:35283 (error 108)
23:48:57.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:57.453791 10208 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10625
23:48:57.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:57.478286 10644 consensus_peers.cc:597] T 7299f299e13343548f3341a23e5a0ee0 P 0bbd3b7684d64d54bae378c85bb641f3 -> Peer 783d9938b0e042a59f828e194dbbd5fc (127.9.248.1:35283): Couldn't send request to peer 783d9938b0e042a59f828e194dbbd5fc. Status: Network error: Client connection negotiation failed: client connection to 127.9.248.1:35283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:48:57.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:57.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:57.496560 10749 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:57.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:57.542 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 0035761b248d44d99ca5e674f4a71d23
23:48:57.545 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4651e453b3bdaedd7e0b318615d226c3448cd8e0a2bf2dbce952fdfadbed61f2'}]
23:48:57.545 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='aede6de03ae4aa35d2c71c04065586e0233e526631e4fa517c9c62e442d0f172'}]
23:48:57.546 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e08e250bedaadb427a5f071fc33ea19a1e70ba537c3cba90ff1f7a9360183c26'}]
23:48:57.547 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:57.548 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:57.548 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:48:57.548 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:57.548 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:48:57.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=298092, tablet=8cf762a7433f4690bd8243d3ae223cfe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785)[L],a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}]
23:48:57.549 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=298091, tablet=d946712f74c14c10a3a819b2b5fbdea4@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785)[L],a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)]}]
23:48:57.555 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:48:57.556 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=298092, tablet=14a063200fb74afa9665736f005dd7fe@[77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935),a06e574087eb4f62863affbc0d2d5eaf(127.9.73.131:40785),a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)[L]]}]
23:48:57.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468137557 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:57.563 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:57.568 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job c4b00a34e6633561fb08795709e8dcd8 (2889 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:48:57.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:48:57.571 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:57.579 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] connecting to peer
23:48:57.590 [DEBUG - kudu-nio-0] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:57.600 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.129
23:48:57.620 [DEBUG - kudu-nio-0] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:57.626 [DEBUG - kudu-nio-0] (Connection.java:757) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] Successfully connected to peer
23:48:57.628 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.129
23:48:57.634 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:57.636 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x780a4603, L:/127.0.0.1:60266 - R:/127.9.73.129:34153] using SASL/PLAIN
23:48:57.641 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.73.129
23:48:57.656 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:57.656 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:57.656 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:57.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:57.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:57.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:57.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:57.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:57.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:57.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:57.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:57.658 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:57.658 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:57.665 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085491347456001) for scanner KuduScanner(table=replication_test_table, tablet=8cf762a7433f4690bd8243d3ae223cfe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:57.666 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:57.666 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [aede6de03ae4aa35d2c71c04065586e0233e526631e4fa517c9c62e442d0f172]
23:48:57.666 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [aede6de03ae4aa35d2c71c04065586e0233e526631e4fa517c9c62e442d0f172]
23:48:57.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:57.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:57.667 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:57.668 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:57.668 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split aede6de03ae4aa35d2c71c04065586e0233e526631e4fa517c9c62e442d0f172 finished by subtask 1; deferring removal (restored in pending)
23:48:57.674 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:48:57.676 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6d903ae9, L:/127.0.0.1:60272 - R:/127.9.73.129:34153] using SASL/PLAIN
23:48:57.682 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x974ed08a, L:/127.0.0.1:60268 - R:/127.9.73.129:34153] using SASL/PLAIN
23:48:57.692 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085491347456001) for scanner KuduScanner(table=replication_test_table, tablet=d946712f74c14c10a3a819b2b5fbdea4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:57.693 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e08e250bedaadb427a5f071fc33ea19a1e70ba537c3cba90ff1f7a9360183c26]
23:48:57.694 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e08e250bedaadb427a5f071fc33ea19a1e70ba537c3cba90ff1f7a9360183c26 finished by subtask 0; deferring removal (restored in pending)
23:48:57.693 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [e08e250bedaadb427a5f071fc33ea19a1e70ba537c3cba90ff1f7a9360183c26]
23:48:57.696 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:48:57.696 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:48:57.696 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:57.696 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:57.697 [DEBUG - kudu-nio-0] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:57.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:57.697 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:57.698 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:57.703 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:57.704 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:57.704 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:57.705 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.706 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:57.706 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.706 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.706 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:57.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:57.707 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:57.716 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.716 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.717 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.717 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.717 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.718 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.718 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.718 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.718 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.718 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.719 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.719 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:57.724 [DEBUG - kudu-nio-0] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:57.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:57.725 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:57.725 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:48:57.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:57.855903 10208 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10625
23:48:57.860 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:57.860 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:57.860 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:57.861 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.861 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.861 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.862 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.862 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.862 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.862 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:57.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468137869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:57.872 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.872 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.872 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.874 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.875 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.879 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:48:57.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
23:48:57.892 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] handling channelInactive
23:48:57.892 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] cleaning up while in state READY due to: connection closed
23:48:57.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:57.892939 10208 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10762
23:48:57.895 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.895 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.895 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.896 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.897 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:57.917807 10884 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:57.937 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085491347456001) for scanner KuduScanner(table=replication_test_table, tablet=14a063200fb74afa9665736f005dd7fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:48:57.938 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [4651e453b3bdaedd7e0b318615d226c3448cd8e0a2bf2dbce952fdfadbed61f2]
23:48:57.938 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4651e453b3bdaedd7e0b318615d226c3448cd8e0a2bf2dbce952fdfadbed61f2]
23:48:57.938 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:48:57.938 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:48:57.938 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:57.939 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4651e453b3bdaedd7e0b318615d226c3448cd8e0a2bf2dbce952fdfadbed61f2 finished by subtask 2; deferring removal (restored in pending)
23:48:57.940 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:57.948 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:57.948 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:57.949 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:57.949 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.949 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.949 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.949 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:57.949 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.949 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:57.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:57.949 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:57.959 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:48:57.960 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:48:57.960 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:48:57.960 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.961 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.961 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:48:57.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.961 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:48:57.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.962 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:48:57.962 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:48:57.971 [DEBUG - kudu-nio-0] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:57.971 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:57.972 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:48:57.972 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:48:57.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:58.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:58.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468138057 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:58.068 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job c4b00a34e6633561fb08795709e8dcd8 (2889 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:48:58.069 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:48:58.069 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split e08e250bedaadb427a5f071fc33ea19a1e70ba537c3cba90ff1f7a9360183c26 from pending
23:48:58.069 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 4651e453b3bdaedd7e0b318615d226c3448cd8e0a2bf2dbce952fdfadbed61f2 from pending
23:48:58.069 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split aede6de03ae4aa35d2c71c04065586e0233e526631e4fa517c9c62e442d0f172 from pending
23:48:58.069 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 3 finished splits from enumerator state
23:48:58.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.103991 10208 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10762
23:48:58.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.124094 10208 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10219
23:48:58.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.125510 10280 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:58.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:58.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.263959 10208 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10219
23:48:58.287 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.62:39393(127.9.248.62:39393)] handling channelInactive
23:48:58.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state READY due to: connection closed
23:48:58.287 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.62:39393(127.9.248.62:39393)] handling channelInactive
23:48:58.287 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.62:39393(127.9.248.62:39393)] handling channelInactive
23:48:58.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state READY due to: connection closed
23:48:58.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state READY due to: connection closed
23:48:58.288 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.62:39393(127.9.248.62:39393)] handling channelInactive
23:48:58.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state READY due to: connection closed
23:48:58.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.288347 10208 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10287
23:48:58.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.289577 10351 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:58.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468138369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:58.378 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:48:58.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
23:48:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.412900 10208 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10287
23:48:58.437 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.61:36251(127.9.248.61:36251)] handling channelInactive
23:48:58.437 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state READY due to: connection closed
23:48:58.437 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.61:36251(127.9.248.61:36251)] handling channelInactive
23:48:58.438 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state READY due to: connection closed
23:48:58.438 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.61:36251(127.9.248.61:36251)] handling channelInactive
23:48:58.438 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.61:36251(127.9.248.61:36251)] handling channelInactive
23:48:58.438 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state READY due to: connection closed
23:48:58.438 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state READY due to: connection closed
23:48:58.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.439389 10208 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10358
23:48:58.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.440716 10425 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:58.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:58.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:58.531 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:58.532 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:58.532 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:58.532 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:58.532 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:58.532 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:58.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:58.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:58.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:58.533 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:58.533 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:58.533 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:58.533 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:58.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468138557 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:58.567 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:48:58.570 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:48:58.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.631758 10208 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10358
23:48:58.656 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.60:35483(127.9.248.60:35483)] handling channelInactive
23:48:58.656 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.60:35483(127.9.248.60:35483)] handling channelInactive
23:48:58.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state READY due to: connection closed
23:48:58.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state READY due to: connection closed
23:48:58.656 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.60:35483(127.9.248.60:35483)] handling channelInactive
23:48:58.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state READY due to: connection closed
23:48:58.657 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.60:35483(127.9.248.60:35483)] handling channelInactive
23:48:58.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state READY due to: connection closed
23:48:58.663 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:48:58.664 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:48:58.664 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:48:58.664 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:58.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:58.664 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:58.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:58.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:48:58.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:48:58.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:58.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:58.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:48:58.665 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:48:58.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:58Z chronyd exiting
23:48:58.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:58.831 [DEBUG - main] (Connection.java:575) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] disconnecting while in state READY
23:48:58.831 [DEBUG - main] (Connection.java:575) [peer master-127.9.73.189:33103(127.9.73.189:33103)] disconnecting while in state READY
23:48:58.831 [DEBUG - main] (Connection.java:575) [peer master-127.9.73.188:35043(127.9.73.188:35043)] disconnecting while in state READY
23:48:58.831 [DEBUG - main] (Connection.java:575) [peer master-127.9.73.190:40177(127.9.73.190:40177)] disconnecting while in state READY
23:48:58.831 [DEBUG - main] (Connection.java:575) [peer 77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)] disconnecting while in state READY
23:48:58.832 [DEBUG - kudu-nio-4] (Connection.java:239) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] handling channelInactive
23:48:58.832 [DEBUG - kudu-nio-4] (Connection.java:709) [peer a42ee4c8ed30413397629819d068081b(127.9.73.129:34153)] cleaning up while in state READY due to: connection closed
23:48:58.832 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.73.189:33103(127.9.73.189:33103)] handling channelInactive
23:48:58.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state READY due to: connection closed
23:48:58.833 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.73.188:35043(127.9.73.188:35043)] handling channelInactive
23:48:58.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state READY due to: connection closed
23:48:58.834 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.73.190:40177(127.9.73.190:40177)] handling channelInactive
23:48:58.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state READY due to: connection closed
23:48:58.834 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:48:58.835 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 29 thread-local buffer(s) from thread: kudu-nio-2
23:48:58.836 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
23:48:58.837 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
23:48:58.837 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)] handling channelInactive
23:48:58.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 77ab6d3c9b044d9c88d6a81463114967(127.9.73.130:43935)] cleaning up while in state READY due to: connection closed
23:48:58.837 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
23:48:58.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.838207  9510 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 9797
23:48:58.839 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-4
23:48:58.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:58.850668  9919 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:58.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468138869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:58.878 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:48:58.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
23:48:58.975 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:58.975 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:58.976 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:58.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:58.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:58.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:58.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:58.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:58.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:58.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:58.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:58.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:58.976 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:58.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:59.010 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:59.012 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:59.012 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:59.012 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:59.012 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.012 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.012 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.013 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:59.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468139057 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:59.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.066967  9510 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 9797
23:48:59.069 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:48:59.070 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:48:59.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.106302  9510 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 9934
23:48:59.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.114497 10056 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:59.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:59.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.256611  9510 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 9934
23:48:59.263 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:59.263 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:59.263 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:59.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:59.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:59.263 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:59.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:59.263 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:59.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:59.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:59.264 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:59.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:59.264 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:59.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:48:59.286355 10088 connection.cc:573] server connection from 127.9.73.130:59987 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:48:59.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.286927  9510 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 10071
23:48:59.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.296836 10193 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:59.369 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468139369 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:59.377 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:48:59.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
23:48:59.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.404470  9510 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 10071
23:48:59.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.424854  9510 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 9527
23:48:59.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.426277  9588 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:59.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:59.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:59.523 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:48:59.523 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:48:59.524 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:48:59.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:59.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:59.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:59.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:48:59.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:59.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:59.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:48:59.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:59.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:48:59.524 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:48:59.524 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:48:59.524 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:48:59.525 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:48:59.525 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:59.525 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:59.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:59.525 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:59.525 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:59.525 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:48:59.525 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:48:59.525 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:59.525 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:48:59.525 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:48:59.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468139557 for job c4b00a34e6633561fb08795709e8dcd8.
23:48:59.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.562844  9510 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 9527
23:48:59.566 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:59.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
23:48:59.588 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.73.190:40177(127.9.73.190:40177)] handling channelInactive
23:48:59.589 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state READY due to: connection closed
23:48:59.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.589134  9510 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 9595
23:48:59.589 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location master-127.9.73.190:40177(127.9.73.190:40177) for tablet Kudu Master: connection closed
23:48:59.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.590597  9659 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:59.596 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:59.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.607 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:59.608 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:59.608 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:59.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.608 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.608 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.608 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.608 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.608 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.609 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.609 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.709582  9510 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 9595
23:48:59.710 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:48:59.716 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:59.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.718 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.718 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:48:59.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.734158  9510 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 9666
23:48:59.734 [ERROR - kudu-nio-1] (Connection.java:452) [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:59.734 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state READY due to: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103]
23:48:59.734 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103]
23:48:59.735 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:48:59.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.735574  9730 generic_service.cc:196] Checking for leaks (request via RPC)
23:48:59.735 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:59.736 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.73.189:33103(127.9.73.189:33103)] handling channelInactive
23:48:59.736 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.736 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.736 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:59.737 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:59.737 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.737 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.737 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.737 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.737 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.738 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.738 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:59.755 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:59.756 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:59.757 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.757 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.757 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.757 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.757 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.757 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:48:59.857215  9510 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 9666
23:48:59.857 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:48:59.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468139869 for job 86e770137b663b638a7b0ce49d5c917b.
23:48:59.876 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:59.876 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:59.877 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.877 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.877 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.877 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.877 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.877 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.877 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:48:59.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
23:48:59.881 [ERROR - kudu-nio-0] (Connection.java:452) [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:48:59.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state READY due to: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043]
23:48:59.882 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043]
23:48:59.882 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:48:59.883 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.73.188:35043(127.9.73.188:35043)] handling channelInactive
23:48:59.892 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:48:59.892 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:48:59.892 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:48:59.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:48:59.893 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.893 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.893 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:48:59.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:48:59.893 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:48:59.915 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:48:59.916 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:59.916 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:59.916 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:48:59.916 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:48:59.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:48:59.916 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.916 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.916 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:48:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:48:59Z chronyd exiting
23:48:59.975 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:48:59.976 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:48:59.976 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:48:59.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:48:59.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:48:59.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:48:59.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.977 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:48:59.977 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.977 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.977 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:48:59.977 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:48:59.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:00.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.23:49:00.033 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468140033
23:49:00.033 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468140033
23:49:00.037 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:49:00.041 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:49:00.041 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:49:00.042 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:49:00.042 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:49:00.042 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:49:00.046 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:49:00.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468140057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:00.067 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:00.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
23:49:00.068 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:00.068 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:00.068 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:00.069 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.069 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.069 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:00.096 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:00.096 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:00.096 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:00.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.097 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.097 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.097 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.097 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.097 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.097 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:00.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:00.295 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:00.296 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:00.296 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:00.296 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.296 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.296 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.296 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.296 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.296 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.296 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:00.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468140369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:00.378 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:00.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
23:49:00.396 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:00.396 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:00.397 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:00.397 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.397 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.397 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:00.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:00.397 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.397 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.397 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:00.397 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:00.403 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:00.403 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:00.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.404 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:00.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.404 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:00.457 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:00.457 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:49:00.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.460965 11359 mini_oidc.cc:150] Starting JWKS server
23:49:00.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.463573 11359 webserver.cc:534] Webserver started at http://127.0.0.1:46429/ using document root <none> and password file <none>
23:49:00.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.463863 11359 mini_oidc.cc:186] Starting OIDC Discovery server
23:49:00.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.464442 11359 webserver.cc:534] Webserver started at http://127.0.0.1:44467/ using document root <none> and password file <none>
23:49:00.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:00.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:00Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:49:00.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:00Z Disabled control of system clock
23:49:00.499 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:00.499 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:00.500 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:00.500 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:00.500 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:00.500 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:00.500 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:00.500 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:00.500 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:00.500 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:00.500 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:00.500 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:00.500 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.501912 11359 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/logs
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data/info.pb
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.254:41819
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.254
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:00.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46429/jwks.json with env {}
23:49:00.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:00.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468140557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:00.567 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:00.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
23:49:00.583 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:00.583 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:00.583 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:00.583 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.583 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:00.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:00.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.584 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.584 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:00.584 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:00.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:00.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468140869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:00.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.878661 11370 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:00.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.879189 11370 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:00.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.879325 11370 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:00.880 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:00.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
23:49:00.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.890362 11370 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:00.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.890482 11370 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:00.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.890543 11370 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:00.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.890584 11370 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:00.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.890638 11370 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:00.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.890673 11370 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46429/jwks.json
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.902025 11370 master_runner.cc:387] Master server non-default flags:
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.254:41819
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46429/jwks.json
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data/info.pb
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.254
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/logs
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:00.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:00.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.903963 11370 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:00.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.905992 11370 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:00.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.916217 11375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:00.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.916173 11376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:00.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:00.916950 11378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:00.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.917809 11370 server_base.cc:1061] running on GCE node
23:49:00.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.918869 11370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:00.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.920696 11370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:00.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.921948 11370 hybrid_clock.cc:648] HybridClock initialized: now 1783468140921890 us; error 62 us; skew 500 ppm
23:49:00.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.922365 11370 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:00.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.925179 11370 webserver.cc:534] Webserver started at http://127.11.23.254:41543/ using document root <none> and password file <none>
23:49:00.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.926065 11370 fs_manager.cc:362] Metadata directory not provided
23:49:00.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.926210 11370 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:00.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.926618 11370 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:00.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.929600 11370 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data/instance:
23:49:00.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3477a53763d5430ba06e8cf26dd9a281"
23:49:00.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:00 on dist-test-slave-hfsf"
23:49:00.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.930554 11370 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal/instance:
23:49:00.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3477a53763d5430ba06e8cf26dd9a281"
23:49:00.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:00 on dist-test-slave-hfsf"
23:49:00.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.936985 11370 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.000s
23:49:00.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.941186 11384 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:00.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.943214 11370 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:49:00.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.943465 11370 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal
23:49:00.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3477a53763d5430ba06e8cf26dd9a281"
23:49:00.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:00 on dist-test-slave-hfsf"
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.943781 11370 fs_report.cc:389] FS layout report
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data/data
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:00.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.959662 11370 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:00.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.960677 11370 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:00.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.960943 11370 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:00.983 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:00.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.983443 11370 rpc_server.cc:307] RPC server started. Bound to: 127.11.23.254:41819
23:49:00.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.983553 11435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.23.254:41819 every 8 connection(s)
23:49:00.984 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:00.984 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:00.984 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:00.984 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:00.984 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:00.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:00.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:00.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:00.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:00.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:00.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:00.984 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:00.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.985561 11370 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/data/info.pb
23:49:00.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:00.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.990602 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:00.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.993542 11359 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 11370
23:49:00.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.993892 11359 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-0/wal/instance
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.996456 11359 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/logs
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data/info.pb
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.253:46397
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.253
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46429/jwks.json with env {}
23:49:00.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:00.998162 11436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } has no permanent_uuid. Determining permanent_uuid...
23:49:01.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:01.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.018985 11436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } has no permanent_uuid. Determining permanent_uuid...
23:49:01.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.020539 11388 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.23.253:46397: connect: Connection refused (error 111)
23:49:01.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.022753 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.253:46397: Network error: Client connection negotiation failed: client connection to 127.11.23.253:46397: connect: Connection refused (error 111)
23:49:01.023 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:01.024 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:01.024 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:01.024 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.024 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.024 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.024 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.024 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.024 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.024 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.024 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.025 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.025 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:01.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468141057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:01.068 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:01.069 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
23:49:01.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.072556 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } attempt: 1
23:49:01.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.075158 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.253:46397: Network error: Client connection negotiation failed: client connection to 127.11.23.253:46397: connect: Connection refused (error 111)
23:49:01.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.143584 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } attempt: 2
23:49:01.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.145896 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.253:46397: Network error: Client connection negotiation failed: client connection to 127.11.23.253:46397: connect: Connection refused (error 111)
23:49:01.212 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:01.212 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:01.213 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:01.213 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.213 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.213 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.213 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.213 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.213 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.213 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.213 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.213 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.213 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:01.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.237188 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } attempt: 3
23:49:01.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.239629 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.253:46397: Network error: Client connection negotiation failed: client connection to 127.11.23.253:46397: connect: Connection refused (error 111)
23:49:01.276 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:01.276 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:01.276 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:01.277 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:01.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:01.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:01.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:01.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:01.277 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:01.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:01.277 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:01.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:01.277 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:01.322 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:01.323 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:01.323 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:01.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.323 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.323 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.323 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.323 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.323 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.323 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:01.344 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:01.344 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:01.344 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:01.344 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.345 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:01.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468141369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:01.379 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:01.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
23:49:01.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.383018 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } attempt: 4
23:49:01.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.385464 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.253:46397: Network error: Client connection negotiation failed: client connection to 127.11.23.253:46397: connect: Connection refused (error 111)
23:49:01.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.403264 11438 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:01.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.403707 11438 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:01.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.403867 11438 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:01.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.413790 11438 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:01.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.413973 11438 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:01.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.414062 11438 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:01.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.414117 11438 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:01.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.414196 11438 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:01.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.414250 11438 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46429/jwks.json
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.425658 11438 master_runner.cc:387] Master server non-default flags:
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.253:46397
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46429/jwks.json
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data/info.pb
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.253
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/logs
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:01.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:01.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.427874 11438 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:01.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.430011 11438 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:01.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.439456 11447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:01.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.439455 11448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:01.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.439805 11450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:01.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.440635 11438 server_base.cc:1061] running on GCE node
23:49:01.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.441434 11438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:01.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.443224 11438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:01.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.444566 11438 hybrid_clock.cc:648] HybridClock initialized: now 1783468141444508 us; error 46 us; skew 500 ppm
23:49:01.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.444918 11438 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:01.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.447500 11438 webserver.cc:534] Webserver started at http://127.11.23.253:37963/ using document root <none> and password file <none>
23:49:01.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.448541 11438 fs_manager.cc:362] Metadata directory not provided
23:49:01.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.448680 11438 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.449123 11438 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:01.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.452467 11438 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data/instance:
23:49:01.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "57c9b8e4b5e947eea080d56f215938db"
23:49:01.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:01 on dist-test-slave-hfsf"
23:49:01.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.453266 11438 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal/instance:
23:49:01.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "57c9b8e4b5e947eea080d56f215938db"
23:49:01.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:01 on dist-test-slave-hfsf"
23:49:01.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.459775 11438 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
23:49:01.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.463994 11456 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:01.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.465560 11438 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
23:49:01.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.465765 11438 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "57c9b8e4b5e947eea080d56f215938db"
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:01 on dist-test-slave-hfsf"
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.465973 11438 fs_report.cc:389] FS layout report
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data/data
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:01.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:01.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:01.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.491433 11438 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:01.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.492408 11438 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:01.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.492660 11438 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:01.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:01.515 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:01.516 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:01.516 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:01.516 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.516 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.516 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.516 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.516 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.516772 11438 rpc_server.cc:307] RPC server started. Bound to: 127.11.23.253:46397
23:49:01.517 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.516754 11507 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.23.253:46397 every 8 connection(s)
23:49:01.517 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.517 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.517 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.517 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:01.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.519196 11438 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/data/info.pb
23:49:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.521551 11359 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 11438
23:49:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.521747 11359 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-1/wal/instance
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.523064 11359 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/logs
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data/info.pb
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.252:40791
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.252
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:01.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46429/jwks.json with env {}
23:49:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.524569 11508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:01.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.531716 11508 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } has no permanent_uuid. Determining permanent_uuid...
23:49:01.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.549049 11508 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } has no permanent_uuid. Determining permanent_uuid...
23:49:01.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468141557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:01.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.560322 11508 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } has no permanent_uuid. Determining permanent_uuid...
23:49:01.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.561797 11460 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.566210 11508 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.570 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:49:01.570 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
23:49:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.615568 11508 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 1
23:49:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.618127 11508 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.636 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:01.637 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:01.637 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:01.637 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.637 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.637 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:01.637 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.637 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.638 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.638 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:01.638 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:01.638 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:01.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.684726 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } attempt: 5
23:49:01.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.686437 11508 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 2
23:49:01.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.688411 11508 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.692315 11436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } has no permanent_uuid. Determining permanent_uuid...
23:49:01.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.694085 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:01.724 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:01.725 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:01.725 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:01.725 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:01.725 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:01.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:01.725 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:01.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:01.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:01.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:01.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:01.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:01.726 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:01.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.745348 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 1
23:49:01.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.747645 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.779670 11508 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 3
23:49:01.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.782233 11508 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.815878 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 2
23:49:01.816 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:01.816 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:01.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.817 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:01.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:01.817 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.817 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.817 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.817 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:01.817 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:01.817 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:01.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.819633 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468141869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:01.878 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:01.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
23:49:01.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.914285 11510 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:01.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.914714 11510 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:01.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.914872 11510 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.925132 11510 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.925248 11510 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.925360 11510 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.925446 11510 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.925544 11510 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.925607 11510 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46429/jwks.json
23:49:01.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.925493 11508 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 4
23:49:01.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.925921 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 3
23:49:01.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.927975 11508 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.928563 11436 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.23.252:40791: Network error: Client connection negotiation failed: client connection to 127.11.23.252:40791: connect: Connection refused (error 111)
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.939438 11510 master_runner.cc:387] Master server non-default flags:
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal
23:49:01.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.252:40791
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46429/jwks.json
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data/info.pb
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.252
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/logs
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:01.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:01.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.941700 11510 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:01.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.943887 11510 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:01.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.954101 11519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:01.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.954136 11520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:01.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:01.954952 11522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:01.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.955608 11510 server_base.cc:1061] running on GCE node
23:49:01.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.956461 11510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:01.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.958214 11510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:01.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.959475 11510 hybrid_clock.cc:648] HybridClock initialized: now 1783468141959392 us; error 68 us; skew 500 ppm
23:49:01.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.959846 11510 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:01.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.962491 11510 webserver.cc:534] Webserver started at http://127.11.23.252:45459/ using document root <none> and password file <none>
23:49:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.963462 11510 fs_manager.cc:362] Metadata directory not provided
23:49:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.963582 11510 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:01.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.964010 11510 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:01.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.967103 11510 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data/instance:
23:49:01.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "58ca1b49ba704abfabf66072ee357f22"
23:49:01.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:01 on dist-test-slave-hfsf"
23:49:01.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.968139 11510 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal/instance:
23:49:01.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "58ca1b49ba704abfabf66072ee357f22"
23:49:01.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:01 on dist-test-slave-hfsf"
23:49:01.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.974500 11510 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
23:49:01.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.979120 11528 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.981159 11510 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.981319 11510 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "58ca1b49ba704abfabf66072ee357f22"
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:01 on dist-test-slave-hfsf"
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.981524 11510 fs_report.cc:389] FS layout report
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data/data
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:01.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:01.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.996286 11510 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:01.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.997180 11510 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:01.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:01.997426 11510 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:02.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:02.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.021023 11510 rpc_server.cc:307] RPC server started. Bound to: 127.11.23.252:40791
23:49:02.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.021205 11579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.23.252:40791 every 8 connection(s)
23:49:02.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.022763 11510 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/data/info.pb
23:49:02.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.024117 11359 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 11510
23:49:02.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.024340 11359 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/master-2/wal/instance
23:49:02.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.029294 11580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:02.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.037727 11580 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } has no permanent_uuid. Determining permanent_uuid...
23:49:02.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.055163 11580 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } has no permanent_uuid. Determining permanent_uuid...
23:49:02.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468142057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:02.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.063341 11580 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } has no permanent_uuid. Determining permanent_uuid...
23:49:02.069 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:49:02.071 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
23:49:02.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.079994 11580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: Bootstrap starting.
23:49:02.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.084252 11580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: Neither blocks nor log segments found. Creating new log.
23:49:02.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.085698 11580 log.cc:826] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: Log is configured to *not* fsync() on all Append() calls
23:49:02.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.089232 11580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: No bootstrap required, opened a new log
23:49:02.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.095227 11580 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.095584 11580 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:02.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.095701 11580 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ca1b49ba704abfabf66072ee357f22, State: Initialized, Role: FOLLOWER
23:49:02.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.096422 11580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.097412 11587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.097710 11587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.098558 11580 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: configured and running, proceeding with master startup.
23:49:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.105808 11436 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 4
23:49:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.113921 11598 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.114354 11598 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.107220 11510 master_runner.cc:187] Error getting master registration for 127.11.23.254:41819: OK, instance_id { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" instance_seqno: 1783468140977328 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:02.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.114748 11510 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:02.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.121081 11436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: Bootstrap starting.
23:49:02.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.126001 11436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: Neither blocks nor log segments found. Creating new log.
23:49:02.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.127652 11436 log.cc:826] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: Log is configured to *not* fsync() on all Append() calls
23:49:02.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.131399 11436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: No bootstrap required, opened a new log
23:49:02.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.140318 11436 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.140734 11436 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:02.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.140866 11436 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3477a53763d5430ba06e8cf26dd9a281, State: Initialized, Role: FOLLOWER
23:49:02.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.141742 11436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.143014 11601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.143347 11601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.144606 11436 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: configured and running, proceeding with master startup.
23:49:02.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.160820 11612 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:02.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.161255 11612 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:02.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.158927 11370 master_runner.cc:187] Error getting master registration for 127.11.23.253:46397: OK, instance_id { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" instance_seqno: 1783468141509822 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:02.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.166903 11370 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:02.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.214432 11390 tablet.cc:2406] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:02.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:02.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.227232 11508 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } attempt: 5
23:49:02.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.244316 11508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: Bootstrap starting.
23:49:02.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.249639 11508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: Neither blocks nor log segments found. Creating new log.
23:49:02.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.249949 11534 tablet.cc:2406] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:02.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.251677 11508 log.cc:826] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: Log is configured to *not* fsync() on all Append() calls
23:49:02.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.257308 11508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: No bootstrap required, opened a new log
23:49:02.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.266562 11508 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.267004 11508 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:02.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.267134 11508 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c9b8e4b5e947eea080d56f215938db, State: Initialized, Role: FOLLOWER
23:49:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.267987 11508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.269335 11615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.269889 11615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.270747 11508 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: configured and running, proceeding with master startup.
23:49:02.336 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:02.336 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:02.336 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:02.337 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:02.337 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:02.337 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:02.337 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:02.338 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:02.338 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:02.338 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:02.338 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:02.338 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:02.338 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:02.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.341810 11626 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:02.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.342147 11626 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:02.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.344527 11438 master_runner.cc:264] No leader master found from master 57c9b8e4b5e947eea080d56f215938db
23:49:02.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.344692 11438 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:02.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468142369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:02.381 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:02.383 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
23:49:02.456 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:02.456 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:02.457 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:02.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:02.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:02.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:02.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:02.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:02.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:02.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:02.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:02.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:02.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:02.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:02.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:02.495537 11462 tablet.cc:2406] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:02.497 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:02.497 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:02.497 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:02.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:02.497 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:02.497 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:02.498 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:02.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:02.498 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:02.498 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:02.498 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:02.498 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:02.498 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:02.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:02.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.542017 11615 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:02.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.542317 11615 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.544420 11615 leader_election.cc:290] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3477a53763d5430ba06e8cf26dd9a281 (127.11.23.254:41819), 58ca1b49ba704abfabf66072ee357f22 (127.11.23.252:40791)
23:49:02.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.546509 11555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57c9b8e4b5e947eea080d56f215938db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ca1b49ba704abfabf66072ee357f22" is_pre_election: true
23:49:02.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.548045 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57c9b8e4b5e947eea080d56f215938db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3477a53763d5430ba06e8cf26dd9a281" is_pre_election: true
23:49:02.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.548575 11411 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57c9b8e4b5e947eea080d56f215938db in term 0.
23:49:02.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.549768 11457 leader_election.cc:304] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3477a53763d5430ba06e8cf26dd9a281, 57c9b8e4b5e947eea080d56f215938db; no voters: 
23:49:02.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.550792 11555 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57c9b8e4b5e947eea080d56f215938db in term 0.
23:49:02.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.553544 11615 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:02.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.553737 11615 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:02.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.553864 11615 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 0 FOLLOWER]: Advancing to term 1
23:49:02.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468142557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:02.574 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:49:02.576 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
23:49:02.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.578097 11615 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.584816 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57c9b8e4b5e947eea080d56f215938db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3477a53763d5430ba06e8cf26dd9a281"
23:49:02.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.585111 11411 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 0 FOLLOWER]: Advancing to term 1
23:49:02.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.587322 11615 leader_election.cc:290] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [CANDIDATE]: Term 1 election: Requested vote from peers 3477a53763d5430ba06e8cf26dd9a281 (127.11.23.254:41819), 58ca1b49ba704abfabf66072ee357f22 (127.11.23.252:40791)
23:49:02.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.588320 11555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57c9b8e4b5e947eea080d56f215938db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ca1b49ba704abfabf66072ee357f22"
23:49:02.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.588591 11555 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 0 FOLLOWER]: Advancing to term 1
23:49:02.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.590190 11411 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c9b8e4b5e947eea080d56f215938db in term 1.
23:49:02.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.591005 11457 leader_election.cc:304] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3477a53763d5430ba06e8cf26dd9a281, 57c9b8e4b5e947eea080d56f215938db; no voters: 
23:49:02.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.593711 11555 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57c9b8e4b5e947eea080d56f215938db in term 1.
23:49:02.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.595072 11615 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 1 FOLLOWER]: Leader election won for term 1
23:49:02.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.611112 11615 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [term 1 LEADER]: Becoming Leader. State: Replica: 57c9b8e4b5e947eea080d56f215938db, State: Running, Role: LEADER
23:49:02.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.612200 11615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } }
23:49:02.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.629087 11628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57c9b8e4b5e947eea080d56f215938db. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.629487 11628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: This master's current role is: LEADER
23:49:02.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.640933 11630 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:49:02.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.644486 11630 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:49:02.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.672883 11555 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [term 1 FOLLOWER]: Refusing update from remote peer 57c9b8e4b5e947eea080d56f215938db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:02.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.674695 11628 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:02.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.683337 11411 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [term 1 FOLLOWER]: Refusing update from remote peer 57c9b8e4b5e947eea080d56f215938db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:02.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.684684 11628 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [LEADER]: Connected to new peer: Peer: permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:02.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.715824 11632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57c9b8e4b5e947eea080d56f215938db. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.716192 11632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.721064 11631 mvcc.cc:204] Tried to move back new op lower bound from 7305085512340144128 to 7305085512166887424. Current Snapshot: MvccSnapshot[applied={T|T < 7305085512340144128}]
23:49:02.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:02.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.722203 11634 mvcc.cc:204] Tried to move back new op lower bound from 7305085512340144128 to 7305085512166887424. Current Snapshot: MvccSnapshot[applied={T|T < 7305085512340144128}]
23:49:02.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.724941 11615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.725258 11615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: This master's current role is: LEADER
23:49:02.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.726945 11633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57c9b8e4b5e947eea080d56f215938db. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.727233 11633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.730070 11635 mvcc.cc:204] Tried to move back new op lower bound from 7305085512340144128 to 7305085512166887424. Current Snapshot: MvccSnapshot[applied={T|T < 7305085512340144128}]
23:49:02.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.730296 11630 catalog_manager.cc:1382] Generated new cluster ID: 10c04b7bdb5c4bb68d2adf5746195c8c
23:49:02.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.730406 11630 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:49:02.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.729514 11628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.735741 11628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db [sys.catalog]: This master's current role is: LEADER
23:49:02.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.739519 11633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.739802 11633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281 [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.743258 11632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57c9b8e4b5e947eea080d56f215938db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3477a53763d5430ba06e8cf26dd9a281" member_type: VOTER last_known_addr { host: "127.11.23.254" port: 41819 } } peers { permanent_uuid: "57c9b8e4b5e947eea080d56f215938db" member_type: VOTER last_known_addr { host: "127.11.23.253" port: 46397 } } peers { permanent_uuid: "58ca1b49ba704abfabf66072ee357f22" member_type: VOTER last_known_addr { host: "127.11.23.252" port: 40791 } } }
23:49:02.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.743494 11632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22 [sys.catalog]: This master's current role is: FOLLOWER
23:49:02.764 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:02.764 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:02.764 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:02.765 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:02.765 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:02.765 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:02.766 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:02.766 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:02.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:02.766 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:02.766 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:02.766 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:02.766 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:02.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.797710 11630 catalog_manager.cc:1405] Generated new certificate authority record
23:49:02.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.799923 11630 catalog_manager.cc:1539] Loading token signing keys...
23:49:02.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.814476 11630 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 57c9b8e4b5e947eea080d56f215938db: Generated new TSK 0
23:49:02.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.815835 11630 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:49:02.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:02.842702 11359 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/logs
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data/info.pb
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.193:0
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.23.193
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.193
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:02.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468142869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:02.878 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:02.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
23:49:02.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.010 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468143057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:03.069 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:49:03.072 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
23:49:03.083 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:03.084 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:03.084 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:03.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.085 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:03.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.116920 11598 catalog_manager.cc:1294] Loaded cluster ID: 10c04b7bdb5c4bb68d2adf5746195c8c
23:49:03.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.117043 11598 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: loading cluster ID for follower catalog manager: success
23:49:03.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.121485 11598 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: acquiring CA information for follower catalog manager: success
23:49:03.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.124406 11598 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 58ca1b49ba704abfabf66072ee357f22: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:03.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.163628 11612 catalog_manager.cc:1294] Loaded cluster ID: 10c04b7bdb5c4bb68d2adf5746195c8c
23:49:03.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.163746 11612 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: loading cluster ID for follower catalog manager: success
23:49:03.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.166589 11612 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: acquiring CA information for follower catalog manager: success
23:49:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.168874 11612 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 3477a53763d5430ba06e8cf26dd9a281: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:03.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.236919 11642 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:03.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.237260 11642 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:03.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.237344 11642 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:03.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.246604 11642 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:03.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.246783 11642 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.23.193
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.258206 11642 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data
23:49:03.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.193:0
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data/info.pb
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.193
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.23.193
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/logs
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:03.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:03.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.260219 11642 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:03.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.262159 11642 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:03.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.273343 11647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:03.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.273430 11648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:03.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.275372 11642 server_base.cc:1061] running on GCE node
23:49:03.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.276491 11650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:03.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.277331 11642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:03.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.278447 11642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:03.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.279733 11642 hybrid_clock.cc:648] HybridClock initialized: now 1783468143279653 us; error 61 us; skew 500 ppm
23:49:03.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.280062 11642 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:03.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.282958 11642 webserver.cc:534] Webserver started at http://127.11.23.193:43871/ using document root <none> and password file <none>
23:49:03.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.283896 11642 fs_manager.cc:362] Metadata directory not provided
23:49:03.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.284030 11642 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:03.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.284353 11642 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:03.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.287220 11642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data/instance:
23:49:03.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "218317d0341d468eb24bf36793f2d4a6"
23:49:03.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:03 on dist-test-slave-hfsf"
23:49:03.288 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:03.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.288224 11642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal/instance:
23:49:03.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "218317d0341d468eb24bf36793f2d4a6"
23:49:03.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:03 on dist-test-slave-hfsf"
23:49:03.288 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:03.288 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:03.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.289 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.289 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.289 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:03.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.294780 11642 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
23:49:03.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.298763 11656 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:03.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.300678 11642 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.003s
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.300846 11642 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "218317d0341d468eb24bf36793f2d4a6"
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:03 on dist-test-slave-hfsf"
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.301061 11642 fs_report.cc:389] FS layout report
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data/data
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:03.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:03.328 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:03.328 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:03.329 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:03.329 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:03.329 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:03.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:03.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:03.329 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:03.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:03.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:03.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:03.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:03.329 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:03.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.342711 11642 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:03.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.343809 11642 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.344072 11642 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:03.345 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:03.345 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:03.345 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:03.345 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:03.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:03.345 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:03.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:03.346 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:03.346 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:03.346 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:03.346 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:03.346 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:03.346 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:03.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.346489 11642 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:03.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.349339 11642 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:03.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.349483 11642 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:03.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.349602 11642 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:03.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.349686 11642 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:03.369 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468143369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:03.380 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:03.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
23:49:03.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.392524 11642 rpc_server.cc:307] RPC server started. Bound to: 127.11.23.193:42471
23:49:03.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.392585 11768 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.23.193:42471 every 8 connection(s)
23:49:03.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.394223 11642 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/data/info.pb
23:49:03.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.396641 11359 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 11642
23:49:03.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.396880 11359 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-0/wal/instance
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.405978 11359 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/logs
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data/info.pb
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.194:0
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.23.194
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.194
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:03.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:03.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:03.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:03.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:03.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.426301 11769 heartbeater.cc:344] Connected to a master server at 127.11.23.252:40791
23:49:03.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.426827 11769 heartbeater.cc:461] Registering TS with master...
23:49:03.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.428089 11769 heartbeater.cc:507] Master 127.11.23.252:40791 requested a full tablet report, sending...
23:49:03.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.429414 11770 heartbeater.cc:344] Connected to a master server at 127.11.23.254:41819
23:49:03.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.429623 11770 heartbeater.cc:461] Registering TS with master...
23:49:03.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.430253 11770 heartbeater.cc:507] Master 127.11.23.254:41819 requested a full tablet report, sending...
23:49:03.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.431286 11545 ts_manager.cc:194] Registered new tserver with Master: 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471)
23:49:03.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.431947 11771 heartbeater.cc:344] Connected to a master server at 127.11.23.253:46397
23:49:03.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.432054 11401 ts_manager.cc:194] Registered new tserver with Master: 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471)
23:49:03.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.432111 11771 heartbeater.cc:461] Registering TS with master...
23:49:03.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.432674 11771 heartbeater.cc:507] Master 127.11.23.253:46397 requested a full tablet report, sending...
23:49:03.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.434499 11473 ts_manager.cc:194] Registered new tserver with Master: 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471)
23:49:03.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.436920 11473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.23.193:37251
23:49:03.463 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:03.463 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:03.463 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:03.463 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.464 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.464 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.464 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.464 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.467 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:03.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.543 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:03.543 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:03.544 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:03.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.544 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.544 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.544 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.544 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:03.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468143557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:03.567 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:03.568 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
23:49:03.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.839422 11779 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:03.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.839766 11779 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:03.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.839952 11779 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:03.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.850112 11779 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:03.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.850304 11779 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.23.194
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.862872 11779 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.194:0
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data/info.pb
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.194
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.23.194
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/logs
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:03.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:03.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.864805 11779 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:03.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.866976 11779 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:03.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468143869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:03.877 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:03.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
23:49:03.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.888247 11785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:03.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.888268 11784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:03.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:03.892684 11787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:03.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.892838 11779 server_base.cc:1061] running on GCE node
23:49:03.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.893997 11779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:03.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.895591 11779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:03.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.896831 11779 hybrid_clock.cc:648] HybridClock initialized: now 1783468143896753 us; error 81 us; skew 500 ppm
23:49:03.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.897199 11779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.900022 11779 webserver.cc:534] Webserver started at http://127.11.23.194:35231/ using document root <none> and password file <none>
23:49:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.900825 11779 fs_manager.cc:362] Metadata directory not provided
23:49:03.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.900923 11779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:03.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.901238 11779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:03.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.904189 11779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data/instance:
23:49:03.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:03.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:03 on dist-test-slave-hfsf"
23:49:03.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.904978 11779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal/instance:
23:49:03.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:03.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:03 on dist-test-slave-hfsf"
23:49:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.911410 11779 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
23:49:03.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.915576 11793 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.917196 11779 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.917361 11779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:03 on dist-test-slave-hfsf"
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.917629 11779 fs_report.cc:389] FS layout report
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data/data
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:03.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:03.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:03.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:03.924 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:03.924 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:03.924 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:03.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:03.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:03.925 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:03.925 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:03.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.937985 11779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:03.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.939231 11779 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:03.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.939594 11779 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:03.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.940744 11779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:03.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.942795 11779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:03.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.942970 11779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
23:49:03.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.943056 11779 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:03.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.943113 11779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:03.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.984141 11779 rpc_server.cc:307] RPC server started. Bound to: 127.11.23.194:36415
23:49:03.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.984162 11905 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.23.194:36415 every 8 connection(s)
23:49:03.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.986073 11779 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/data/info.pb
23:49:03.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:03.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.987265 11359 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 11779
23:49:03.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.987550 11359 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-1/wal/instance
23:49:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:03.996693 11359 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/logs
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data/info.pb
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.195:0
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.23.195
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.195
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:04.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.009124 11906 heartbeater.cc:344] Connected to a master server at 127.11.23.252:40791
23:49:04.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.009907 11906 heartbeater.cc:461] Registering TS with master...
23:49:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.011303 11906 heartbeater.cc:507] Master 127.11.23.252:40791 requested a full tablet report, sending...
23:49:04.012 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:04.016 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:04.016 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:04.016 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:04.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:04.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:04.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:04.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:04.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:04.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:04.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:04.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:04.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:04.017 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:04.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.018749 11545 ts_manager.cc:194] Registered new tserver with Master: 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:04.019 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:04.020 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:04.020 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:04.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:04.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:04.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:04.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:04.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:04.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:04.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:04.022 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:04.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:04.022 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.033026 11907 heartbeater.cc:344] Connected to a master server at 127.11.23.254:41819
23:49:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.033214 11907 heartbeater.cc:461] Registering TS with master...
23:49:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.033772 11907 heartbeater.cc:507] Master 127.11.23.254:41819 requested a full tablet report, sending...
23:49:04.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.035296 11401 ts_manager.cc:194] Registered new tserver with Master: 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:04.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.043145 11908 heartbeater.cc:344] Connected to a master server at 127.11.23.253:46397
23:49:04.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.043360 11908 heartbeater.cc:461] Registering TS with master...
23:49:04.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.043900 11908 heartbeater.cc:507] Master 127.11.23.253:46397 requested a full tablet report, sending...
23:49:04.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.045085 11473 ts_manager.cc:194] Registered new tserver with Master: 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:04.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.046190 11473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.23.194:59031
23:49:04.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468144057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:04.068 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:04.069 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
23:49:04.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:04.303 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:04.303 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:04.304 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:04.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:04.304 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:04.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:04.304 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:04.304 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:04.304 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:04.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:04.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:04.304 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:04.304 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:04.369 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468144369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:04.377 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
23:49:04.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
23:49:04.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.394021 11916 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:04.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.394326 11916 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:04.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.394413 11916 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:04.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.403856 11916 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:04.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.404100 11916 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.23.195
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.415267 11916 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.23.212:37661
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.23.195:0
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data/info.pb
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.23.195
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.23.195
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/logs
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:04.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:04.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.417336 11916 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:04.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.419485 11916 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:04.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.430431 11922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:04.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.430431 11921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:04.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:04.431514 11924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:04.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.431993 11916 server_base.cc:1061] running on GCE node
23:49:04.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.432686 11916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:04.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.433981 11916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:04.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.435395 11916 hybrid_clock.cc:648] HybridClock initialized: now 1783468144435277 us; error 110 us; skew 500 ppm
23:49:04.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.435770 11916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:04.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.438236 11916 webserver.cc:534] Webserver started at http://127.11.23.195:37197/ using document root <none> and password file <none>
23:49:04.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.439127 11916 fs_manager.cc:362] Metadata directory not provided
23:49:04.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.439222 11916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:04.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.439550 11916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:04.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.440299 11771 heartbeater.cc:499] Master 127.11.23.253:46397 was elected leader, sending a full tablet report...
23:49:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.442373 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data/instance:
23:49:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "72e4797b3a554897bc93a0a707e1dd39"
23:49:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:04 on dist-test-slave-hfsf"
23:49:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.443384 11916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal/instance:
23:49:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "72e4797b3a554897bc93a0a707e1dd39"
23:49:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:04 on dist-test-slave-hfsf"
23:49:04.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.450026 11916 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:49:04.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.454617 11930 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:04.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.456290 11916 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:49:04.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.456485 11916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal
23:49:04.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "72e4797b3a554897bc93a0a707e1dd39"
23:49:04.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:04 on dist-test-slave-hfsf"
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.457003 11916 fs_report.cc:389] FS layout report
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data/data
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:04.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:04.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.481726 11916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:04.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.482633 11916 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.482967 11916 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:04.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.484046 11916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:04.485 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:04.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.486127 11916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:04.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.486270 11916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:04.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.486351 11916 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:04.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.486398 11916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:04.496 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:04.496 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:04.496 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:04.497 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:04.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:04.497 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:04.497 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:04.497 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:04.497 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:04.497 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:04.497 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:04.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:04.497 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:04.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.548795 11916 rpc_server.cc:307] RPC server started. Bound to: 127.11.23.195:43301
23:49:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.548898 12042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.23.195:43301 every 8 connection(s)
23:49:04.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.550633 11916 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/data/info.pb
23:49:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.556054 11359 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 11916
23:49:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.556219 11359 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster15743169456780826713/ts-2/wal/instance
23:49:04.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468144557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:04.568 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:04.569 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
23:49:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.592018 12043 heartbeater.cc:344] Connected to a master server at 127.11.23.252:40791
23:49:04.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.592483 12043 heartbeater.cc:461] Registering TS with master...
23:49:04.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.593860 12043 heartbeater.cc:507] Master 127.11.23.252:40791 requested a full tablet report, sending...
23:49:04.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.596043 11545 ts_manager.cc:194] Registered new tserver with Master: 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:04.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.599558 12044 heartbeater.cc:344] Connected to a master server at 127.11.23.254:41819
23:49:04.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.599733 12044 heartbeater.cc:461] Registering TS with master...
23:49:04.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.600309 12044 heartbeater.cc:507] Master 127.11.23.254:41819 requested a full tablet report, sending...
23:49:04.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.601872 11401 ts_manager.cc:194] Registered new tserver with Master: 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:04.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.602514 12045 heartbeater.cc:344] Connected to a master server at 127.11.23.253:46397
23:49:04.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.602644 12045 heartbeater.cc:461] Registering TS with master...
23:49:04.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.603231 12045 heartbeater.cc:507] Master 127.11.23.253:46397 requested a full tablet report, sending...
23:49:04.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.604346 11473 ts_manager.cc:194] Registered new tserver with Master: 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:04.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.605441 11473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.23.195:55661
23:49:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.606796 11359 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:49:04.609 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:04.609 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:49:04.610 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.23.254"
      port: 41819
    }
    bound_http_address {
      host: "127.11.23.254"
      port: 41543
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.23.253"
      port: 46397
    }
    bound_http_address {
      host: "127.11.23.253"
      port: 37963
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.23.252"
      port: 40791
    }
    bound_http_address {
      host: "127.11.23.252"
      port: 45459
    }
  }
}

23:49:04.611 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:49:04.611 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.23.193"
      port: 42471
    }
    bound_http_address {
      host: "127.11.23.193"
      port: 43871
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.23.194"
      port: 36415
    }
    bound_http_address {
      host: "127.11.23.194"
      port: 35231
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.23.195"
      port: 43301
    }
    bound_http_address {
      host: "127.11.23.195"
      port: 37197
    }
  }
}

23:49:04.611 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:49:04.613 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:04.613 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:49:04.613 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:49:04.614 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:49:04.614 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:49:04.618 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:49:04.643 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:04.643 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:04.643 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:04.644 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:04.644 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:04.644 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:04.644 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:04.644 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:04.644 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:04.644 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:04.644 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:04.644 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:04.644 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:04.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:04.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468144869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:04.879 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:04.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
23:49:04.964 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:04.964 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:04.965 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:04.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:04.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:04.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:04.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:04.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:04.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:04.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:04.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:04.966 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:04.966 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:04.985 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:04.985 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:04.986 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:49:04.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.989404 12053 mini_oidc.cc:150] Starting JWKS server
23:49:04.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.992292 12053 webserver.cc:534] Webserver started at http://127.0.0.1:35993/ using document root <none> and password file <none>
23:49:04.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.992533 12053 mini_oidc.cc:186] Starting OIDC Discovery server
23:49:04.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:04.993078 12053 webserver.cc:534] Webserver started at http://127.0.0.1:44847/ using document root <none> and password file <none>
23:49:05.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:05.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:49:05.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:05Z Disabled control of system clock
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.028371 12053 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/logs
23:49:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data/info.pb
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.126:39201
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.126
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:05.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35993/jwks.json with env {}
23:49:05.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.049229 11908 heartbeater.cc:499] Master 127.11.23.253:46397 was elected leader, sending a full tablet report...
23:49:05.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468145057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:05.066 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:05.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
23:49:05.124 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:05.124 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:05.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.125 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:05.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.125 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:05.212 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:05.212 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:05.212 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:05.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.213 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.213 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.213 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.213 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.213 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.213 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.213 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:05.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:05.242 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:05.243 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:05.243 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:05.243 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.243 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.243 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.244 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.244 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.244 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.244 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:05.276 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:05.276 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:05.276 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:05.276 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.277 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:05.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.277 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.277 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.277 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.277 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:05.277 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:05.277 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:05.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468145369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:05.377 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:49:05.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
23:49:05.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.411504 12064 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:05.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.411832 12064 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:05.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.411921 12064 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:05.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.420933 12064 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:05.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.421042 12064 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:05.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.421097 12064 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:05.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.421137 12064 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:05.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.421191 12064 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:05.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.421226 12064 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35993/jwks.json
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.433070 12064 master_runner.cc:387] Master server non-default flags:
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.126:39201
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35993/jwks.json
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data/info.pb
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.126
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/logs
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:05.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:05.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:05.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:05.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.435133 12064 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:05.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.437747 12064 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:05.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.446534 12069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:05.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.446560 12070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:05.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.448484 12072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:05.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.449673 12064 server_base.cc:1061] running on GCE node
23:49:05.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.450641 12064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:05.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.452498 12064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:05.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.453786 12064 hybrid_clock.cc:648] HybridClock initialized: now 1783468145453706 us; error 59 us; skew 500 ppm
23:49:05.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.454356 12064 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:05.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.457520 12064 webserver.cc:534] Webserver started at http://127.11.197.126:38277/ using document root <none> and password file <none>
23:49:05.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.458665 12064 fs_manager.cc:362] Metadata directory not provided
23:49:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.458871 12064 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.459360 12064 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.463006 12064 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data/instance:
23:49:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "409d65c7d361401fb2f015abf1527db6"
23:49:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:05 on dist-test-slave-hfsf"
23:49:05.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.464287 12064 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal/instance:
23:49:05.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "409d65c7d361401fb2f015abf1527db6"
23:49:05.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:05 on dist-test-slave-hfsf"
23:49:05.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.472795 12064 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
23:49:05.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.477003 12078 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:05.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.478627 12064 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.478793 12064 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "409d65c7d361401fb2f015abf1527db6"
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:05 on dist-test-slave-hfsf"
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.479264 12064 fs_report.cc:389] FS layout report
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data/data
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:05.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:05.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.501096 12064 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:05.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.502123 12064 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:05.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.502369 12064 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:05.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:05.516 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:05.516 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:05.516 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:05.517 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:05.517 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:05.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:05.517 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:05.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:05.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:05.517 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:05.517 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:05.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:05.518 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.531541 12064 rpc_server.cc:307] RPC server started. Bound to: 127.11.197.126:39201
23:49:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.531606 12129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.197.126:39201 every 8 connection(s)
23:49:05.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.533182 12064 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/data/info.pb
23:49:05.535 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:05.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:05.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:05.536 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.536 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.536 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.537 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:05.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.538460 12130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:05.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.539645 12053 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 12064
23:49:05.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.539994 12053 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-0/wal/instance
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.542553 12053 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/logs
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data/info.pb
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.125:42079
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.125
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35993/jwks.json with env {}
23:49:05.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.546464 12130 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } has no permanent_uuid. Determining permanent_uuid...
23:49:05.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468145557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:05.567 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:05.568 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
23:49:05.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.575924 12130 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } has no permanent_uuid. Determining permanent_uuid...
23:49:05.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.577577 12081 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.197.125:42079: connect: Connection refused (error 111)
23:49:05.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.579556 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.125:42079: Network error: Client connection negotiation failed: client connection to 127.11.197.125:42079: connect: Connection refused (error 111)
23:49:05.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.608650 12045 heartbeater.cc:499] Master 127.11.23.253:46397 was elected leader, sending a full tablet report...
23:49:05.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.628937 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } attempt: 1
23:49:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.631242 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.125:42079: Network error: Client connection negotiation failed: client connection to 127.11.197.125:42079: connect: Connection refused (error 111)
23:49:05.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.699585 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } attempt: 2
23:49:05.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.702215 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.125:42079: Network error: Client connection negotiation failed: client connection to 127.11.197.125:42079: connect: Connection refused (error 111)
23:49:05.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.793514 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } attempt: 3
23:49:05.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.796013 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.125:42079: Network error: Client connection negotiation failed: client connection to 127.11.197.125:42079: connect: Connection refused (error 111)
23:49:05.836 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:05.836 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:05.836 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:05.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.836 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.836 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.836 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.837 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:05.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:05.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:05.837 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:05.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468145869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:05.877 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:49:05.877 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
23:49:05.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.938992 12132 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:05.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.939329 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } attempt: 4
23:49:05.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.939523 12132 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:05.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.939642 12132 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:05.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.941831 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.125:42079: Network error: Client connection negotiation failed: client connection to 127.11.197.125:42079: connect: Connection refused (error 111)
23:49:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.949434 12132 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.949584 12132 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.949657 12132 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.949698 12132 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.949751 12132 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.949785 12132 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35993/jwks.json
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.961321 12132 master_runner.cc:387] Master server non-default flags:
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.125:42079
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35993/jwks.json
23:49:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data/info.pb
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.125
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/logs
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:05.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.963328 12132 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:05.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.965385 12132 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:05.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.974272 12140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:05.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.974265 12141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:05.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:05.976107 12143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:05.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.976060 12132 server_base.cc:1061] running on GCE node
23:49:05.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.977160 12132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.978945 12132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.980233 12132 hybrid_clock.cc:648] HybridClock initialized: now 1783468145980163 us; error 59 us; skew 500 ppm
23:49:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.980597 12132 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:05.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.983067 12132 webserver.cc:534] Webserver started at http://127.11.197.125:37243/ using document root <none> and password file <none>
23:49:05.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.984018 12132 fs_manager.cc:362] Metadata directory not provided
23:49:05.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.984180 12132 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:05.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.984563 12132 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:05.986 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.987730 12132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data/instance:
23:49:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ed8195727544d2e9a45a33cbd9c26ad"
23:49:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:05 on dist-test-slave-hfsf"
23:49:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.988662 12132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal/instance:
23:49:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ed8195727544d2e9a45a33cbd9c26ad"
23:49:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:05 on dist-test-slave-hfsf"
23:49:05.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.995280 12132 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
23:49:06.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:05.999719 12149 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:06.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.001631 12132 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.001863 12132 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ed8195727544d2e9a45a33cbd9c26ad"
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:05 on dist-test-slave-hfsf"
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.002146 12132 fs_report.cc:389] FS layout report
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data/data
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:06.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:06.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:06.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.021181 12132 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.022137 12132 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.022456 12132 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:06.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.046056 12132 rpc_server.cc:307] RPC server started. Bound to: 127.11.197.125:42079
23:49:06.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.046125 12200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.197.125:42079 every 8 connection(s)
23:49:06.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.047833 12132 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/data/info.pb
23:49:06.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.049603 12053 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 12132
23:49:06.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.049783 12053 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-1/wal/instance
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.051252 12053 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/logs
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data/info.pb
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.124:40009
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.124
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:06.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:06.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35993/jwks.json with env {}
23:49:06.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.055256 12201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:06.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468146057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:06.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.066334 12201 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.072 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:49:06.074 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
23:49:06.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.084250 12201 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.095232 12201 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.096572 12150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.098335 12201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.147758 12201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 1
23:49:06.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.150110 12201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.218379 12201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 2
23:49:06.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.220779 12201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:06.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.241104 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } attempt: 5
23:49:06.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.249259 12130 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.251374 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.302637 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 1
23:49:06.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.304827 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.312033 12201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 3
23:49:06.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.314289 12201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468146369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:06.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.373157 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 2
23:49:06.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.380395 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.380 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:06.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
23:49:06.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.443008 12203 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:06.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.443432 12203 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:06.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.443588 12203 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.453274 12203 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.453472 12203 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.453568 12203 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.453636 12203 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.453737 12203 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.453851 12203 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35993/jwks.json
23:49:06.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.457548 12201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 4
23:49:06.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.460067 12201 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.465754 12203 master_runner.cc:387] Master server non-default flags:
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.124:40009
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35993/jwks.json
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data/info.pb
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.124
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/logs
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:06.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:06.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.468192 12203 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:06.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.470628 12203 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:06.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.480242 12212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:06.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.480275 12213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:06.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.481412 12215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:06.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.481988 12203 server_base.cc:1061] running on GCE node
23:49:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.483079 12203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.485044 12203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:06.486 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.486377 12203 hybrid_clock.cc:648] HybridClock initialized: now 1783468146486309 us; error 45 us; skew 500 ppm
23:49:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.486644 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 3
23:49:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.486887 12203 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:06.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.489041 12130 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.197.124:40009: Network error: Client connection negotiation failed: client connection to 127.11.197.124:40009: connect: Connection refused (error 111)
23:49:06.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.489823 12203 webserver.cc:534] Webserver started at http://127.11.197.124:36829/ using document root <none> and password file <none>
23:49:06.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.490746 12203 fs_manager.cc:362] Metadata directory not provided
23:49:06.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.490959 12203 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:06.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.491375 12203 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:06.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.494247 12203 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data/instance:
23:49:06.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9252b3440bfb48468a8db2d35b6826f0"
23:49:06.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:06 on dist-test-slave-hfsf"
23:49:06.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.495486 12203 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal/instance:
23:49:06.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9252b3440bfb48468a8db2d35b6826f0"
23:49:06.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:06 on dist-test-slave-hfsf"
23:49:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.502780 12203 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
23:49:06.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.507253 12221 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.509060 12203 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.509285 12203 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9252b3440bfb48468a8db2d35b6826f0"
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:06 on dist-test-slave-hfsf"
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.509492 12203 fs_report.cc:389] FS layout report
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data/data
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:06.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:06.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:06.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.532665 12203 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:06.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.533679 12203 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:06.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.534018 12203 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:06.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468146557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:06.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.558490 12203 rpc_server.cc:307] RPC server started. Bound to: 127.11.197.124:40009
23:49:06.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.558549 12272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.197.124:40009 every 8 connection(s)
23:49:06.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.560858 12203 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/data/info.pb
23:49:06.565 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:49:06.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
23:49:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.566816 12273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.567234 12053 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 12203
23:49:06.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.567438 12053 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/master-2/wal/instance
23:49:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.575362 12273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.603767 12273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.611896 12273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } has no permanent_uuid. Determining permanent_uuid...
23:49:06.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.623041 12273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: Bootstrap starting.
23:49:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.626945 12273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: Neither blocks nor log segments found. Creating new log.
23:49:06.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.628204 12273 log.cc:826] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: Log is configured to *not* fsync() on all Append() calls
23:49:06.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.631757 12273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: No bootstrap required, opened a new log
23:49:06.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.637187 12273 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:06.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.637547 12273 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:06.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.637689 12273 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9252b3440bfb48468a8db2d35b6826f0, State: Initialized, Role: FOLLOWER
23:49:06.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.638388 12273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:06.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.639667 12280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:06.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.639999 12280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: This master's current role is: FOLLOWER
23:49:06.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.641079 12273 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: configured and running, proceeding with master startup.
23:49:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.653622 12291 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.653771 12291 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:06.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.648933 12203 master_runner.cc:187] Error getting master registration for 127.11.197.126:39201: OK, instance_id { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" instance_seqno: 1783468145521221 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:06.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.655733 12203 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:06.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.666321 12130 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 4
23:49:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.679826 12130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: Bootstrap starting.
23:49:06.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.684413 12130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: Neither blocks nor log segments found. Creating new log.
23:49:06.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.685881 12130 log.cc:826] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: Log is configured to *not* fsync() on all Append() calls
23:49:06.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.690771 12130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: No bootstrap required, opened a new log
23:49:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.696856 12130 raft_consensus.cc:359] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.697234 12130 raft_consensus.cc:385] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.697343 12130 raft_consensus.cc:740] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 409d65c7d361401fb2f015abf1527db6, State: Initialized, Role: FOLLOWER
23:49:06.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.697999 12130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:06.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.699005 12294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:06.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.699379 12294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: This master's current role is: FOLLOWER
23:49:06.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.700455 12130 sys_catalog.cc:565] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: configured and running, proceeding with master startup.
23:49:06.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.712337 12305 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:06.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.712473 12305 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:06.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.711668 12064 master_runner.cc:187] Error getting master registration for 127.11.197.125:42079: OK, instance_id { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" instance_seqno: 1783468146039768 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:06.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.720796 12064 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:06.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.755934 12084 tablet.cc:2406] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:06.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.759347 12201 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } attempt: 5
23:49:06.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.774228 12201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: Bootstrap starting.
23:49:06.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.780907 12201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: Neither blocks nor log segments found. Creating new log.
23:49:06.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.782630 12201 log.cc:826] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: Log is configured to *not* fsync() on all Append() calls
23:49:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.786458 12201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: No bootstrap required, opened a new log
23:49:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.786568 12227 tablet.cc:2406] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:06.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.797485 12201 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.798101 12201 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.798440 12201 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed8195727544d2e9a45a33cbd9c26ad, State: Initialized, Role: FOLLOWER
23:49:06.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.799612 12201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.800968 12308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.801285 12308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: This master's current role is: FOLLOWER
23:49:06.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.803020 12201 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: configured and running, proceeding with master startup.
23:49:06.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.832921 12319 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:06.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:06.833094 12319 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:06.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.833612 12132 master_runner.cc:264] No leader master found from master 2ed8195727544d2e9a45a33cbd9c26ad
23:49:06.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:06.833750 12132 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:06.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468146869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:06.880 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:06.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
23:49:06.988 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:06.988 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:06.988 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:06.989 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:06.989 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:06.989 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:06.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:06.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:06.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:06.991 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:06.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:06.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:06.991 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:06.992 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:06.994 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28492), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [47ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [56ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [56ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [75ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [76ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [76ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [105ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [105ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [123ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [123ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [123ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [142ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [144ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [183ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [183ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [183ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [264ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [264ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [265ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [462ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [463ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [463ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [464ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [504ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [504ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [505ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [603ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [603ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [604ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [604ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1220ms] refreshing cache from master, [1220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1224ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1224ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [3000ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [3002ms] too many traces: truncated at 100 traces, deferred=Deferred@1010400894(state=PENDING, result=null, callback=(continuation of Deferred@955615775 after retry RPC after error@777875132) -> (continuation of Deferred@1472997394 after retry RPC after error@544302619) -> (continuation of Deferred@885044600 after retry RPC after error@1907168722) -> (continuation of Deferred@1192701773 after retry RPC after error@1828575242) -> (continuation of Deferred@1571281816 after retry RPC after error@1153255035) -> (continuation of Deferred@976123110 after retry RPC after error@940688929) -> (continuation of Deferred@1535746464 after retry RPC after error@1965664820) -> (continuation of Deferred@1021933875 after retry RPC after error@176128065) -> (continuation of Deferred@476947471 after retry RPC after error@615368124) -> (continuation of Deferred@1400504571 after retry RPC after error@636612445) -> (continuation of Deferred@1414363696 after retry RPC after error@512214304) -> (continuation of Deferred@502887379 after retry RPC after error@936963126) -> (continuation of Deferred@150703111 after retry RPC after error@687208189) -> (continuation of Deferred@2126807003 after retry RPC after error@244159849) -> (continuation of Deferred@1514318603 after retry RPC after error@1569189024) -> (continuation of Deferred@14711404 after retry RPC after error@1646559684) -> (continuation of Deferred@770798712 after retry RPC after error@1332838282) -> (continuation of Deferred@1279352594 after retry RPC after error@179166719) -> (continuation of Deferred@744041062 after retry RPC after error@1745915208) -> (continuation of Deferred@787474071 after retry RPC after error@1246336144) -> (continuation of Deferred@799444389 after retry RPC after error@1135620052) -> (continuation of Deferred@314225259 after retry RPC after error@340871608) -> (continuation of Deferred@251733298 after retry RPC after error@1301116297) -> (continuation of Deferred@174305209 after retry RPC after error@350305220) -> (continuation of Deferred@307213535 after retry RPC after error@885565986), errback=(continuation of Deferred@955615775 after retry RPC after error@777875132) -> (continuation of Deferred@1472997394 after retry RPC after error@544302619) -> (continuation of Deferred@885044600 after retry RPC after error@1907168722) -> (continuation of Deferred@1192701773 after retry RPC after error@1828575242) -> (continuation of Deferred@1571281816 after retry RPC after error@1153255035) -> (continuation of Deferred@976123110 after retry RPC after error@940688929) -> (continuation of Deferred@1535746464 after retry RPC after error@1965664820) -> (continuation of Deferred@1021933875 after retry RPC after error@176128065) -> (continuation of Deferred@476947471 after retry RPC after error@615368124) -> (continuation of Deferred@1400504571 after retry RPC after error@636612445) -> (continuation of Deferred@1414363696 after retry RPC after error@512214304) -> (continuation of Deferred@502887379 after retry RPC after error@936963126) -> (continuation of Deferred@150703111 after retry RPC after error@687208189) -> (continuation of Deferred@2126807003 after retry RPC after error@244159849) -> (continuation of Deferred@1514318603 after retry RPC after error@1569189024) -> (continuation of Deferred@14711404 after retry RPC after error@1646559684) -> (continuation of Deferred@770798712 after retry RPC after error@1332838282) -> (continuation of Deferred@1279352594 after retry RPC after error@179166719) -> (continuation of Deferred@744041062 after retry RPC after error@1745915208) -> (continuation of Deferred@787474071 after retry RPC after error@1246336144) -> (continuation of Deferred@799444389 after retry RPC after error@1135620052) -> (continuation of Deferred@314225259 after retry RPC after error@340871608) -> (continuation of Deferred@251733298 after retry RPC after error@1301116297) -> (continuation of Deferred@174305209 after retry RPC after error@350305220) -> (continuation of Deferred@307213535 after retry RPC after error@885565986)))
23:49:06.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:06.996 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28492), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [47ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [56ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [56ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [75ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [76ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [76ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [105ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [105ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [123ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [123ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [123ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [142ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [144ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [183ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [183ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [183ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [264ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [264ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [265ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [462ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [463ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [463ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [464ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [504ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [504ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [505ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [603ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [603ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [604ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [604ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1220ms] refreshing cache from master, [1220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1224ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1224ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [3000ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [3002ms] too many traces: truncated at 100 traces, deferred=Deferred@1010400894(state=PENDING, result=null, callback=(continuation of Deferred@955615775 after retry RPC after error@777875132) -> (continuation of Deferred@1472997394 after retry RPC after error@544302619) -> (continuation of Deferred@885044600 after retry RPC after error@1907168722) -> (continuation of Deferred@1192701773 after retry RPC after error@1828575242) -> (continuation of Deferred@1571281816 after retry RPC after error@1153255035) -> (continuation of Deferred@976123110 after retry RPC after error@940688929) -> (continuation of Deferred@1535746464 after retry RPC after error@1965664820) -> (continuation of Deferred@1021933875 after retry RPC after error@176128065) -> (continuation of Deferred@476947471 after retry RPC after error@615368124) -> (continuation of Deferred@1400504571 after retry RPC after error@636612445) -> (continuation of Deferred@1414363696 after retry RPC after error@512214304) -> (continuation of Deferred@502887379 after retry RPC after error@936963126) -> (continuation of Deferred@150703111 after retry RPC after error@687208189) -> (continuation of Deferred@2126807003 after retry RPC after error@244159849) -> (continuation of Deferred@1514318603 after retry RPC after error@1569189024) -> (continuation of Deferred@14711404 after retry RPC after error@1646559684) -> (continuation of Deferred@770798712 after retry RPC after error@1332838282) -> (continuation of Deferred@1279352594 after retry RPC after error@179166719) -> (continuation of Deferred@744041062 after retry RPC after error@1745915208) -> (continuation of Deferred@787474071 after retry RPC after error@1246336144) -> (continuation of Deferred@799444389 after retry RPC after error@1135620052) -> (continuation of Deferred@314225259 after retry RPC after error@340871608) -> (continuation of Deferred@251733298 after retry RPC after error@1301116297) -> (continuation of Deferred@174305209 after retry RPC after error@350305220) -> (continuation of Deferred@307213535 after retry RPC after error@885565986), errback=(continuation of Deferred@955615775 after retry RPC after error@777875132) -> (continuation of Deferred@1472997394 after retry RPC after error@544302619) -> (continuation of Deferred@885044600 after retry RPC after error@1907168722) -> (continuation of Deferred@1192701773 after retry RPC after error@1828575242) -> (continuation of Deferred@1571281816 after retry RPC after error@1153255035) -> (continuation of Deferred@976123110 after retry RPC after error@940688929) -> (continuation of Deferred@1535746464 after retry RPC after error@1965664820) -> (continuation of Deferred@1021933875 after retry RPC after error@176128065) -> (continuation of Deferred@476947471 after retry RPC after error@615368124) -> (continuation of Deferred@1400504571 after retry RPC after error@636612445) -> (continuation of Deferred@1414363696 after retry RPC after error@512214304) -> (continuation of Deferred@502887379 after retry RPC after error@936963126) -> (continuation of Deferred@150703111 after retry RPC after error@687208189) -> (continuation of Deferred@2126807003 after retry RPC after error@244159849) -> (continuation of Deferred@1514318603 after retry RPC after error@1569189024) -> (continuation of Deferred@14711404 after retry RPC after error@1646559684) -> (continuation of Deferred@770798712 after retry RPC after error@1332838282) -> (continuation of Deferred@1279352594 after retry RPC after error@179166719) -> (continuation of Deferred@744041062 after retry RPC after error@1745915208) -> (continuation of Deferred@787474071 after retry RPC after error@1246336144) -> (continuation of Deferred@799444389 after retry RPC after error@1135620052) -> (continuation of Deferred@314225259 after retry RPC after error@340871608) -> (continuation of Deferred@251733298 after retry RPC after error@1301116297) -> (continuation of Deferred@174305209 after retry RPC after error@350305220) -> (continuation of Deferred@307213535 after retry RPC after error@885565986)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.254:41393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:06.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
23:49:06.999 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
23:49:07.002 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28492), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [47ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [56ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [56ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [75ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [76ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [76ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [105ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [105ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [123ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [123ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [123ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [142ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [144ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [144ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [183ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [183ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [183ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [264ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [264ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [265ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [462ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [463ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [463ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [464ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [504ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [504ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [505ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [603ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [603ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [604ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [604ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1220ms] refreshing cache from master, [1220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1224ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1224ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [3000ms] refreshing cache from master, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [3002ms] too many traces: truncated at 100 traces, deferred=Deferred@1010400894(state=PENDING, result=null, callback=(continuation of Deferred@955615775 after retry RPC after error@777875132) -> (continuation of Deferred@1472997394 after retry RPC after error@544302619) -> (continuation of Deferred@885044600 after retry RPC after error@1907168722) -> (continuation of Deferred@1192701773 after retry RPC after error@1828575242) -> (continuation of Deferred@1571281816 after retry RPC after error@1153255035) -> (continuation of Deferred@976123110 after retry RPC after error@940688929) -> (continuation of Deferred@1535746464 after retry RPC after error@1965664820) -> (continuation of Deferred@1021933875 after retry RPC after error@176128065) -> (continuation of Deferred@476947471 after retry RPC after error@615368124) -> (continuation of Deferred@1400504571 after retry RPC after error@636612445) -> (continuation of Deferred@1414363696 after retry RPC after error@512214304) -> (continuation of Deferred@502887379 after retry RPC after error@936963126) -> (continuation of Deferred@150703111 after retry RPC after error@687208189) -> (continuation of Deferred@2126807003 after retry RPC after error@244159849) -> (continuation of Deferred@1514318603 after retry RPC after error@1569189024) -> (continuation of Deferred@14711404 after retry RPC after error@1646559684) -> (continuation of Deferred@770798712 after retry RPC after error@1332838282) -> (continuation of Deferred@1279352594 after retry RPC after error@179166719) -> (continuation of Deferred@744041062 after retry RPC after error@1745915208) -> (continuation of Deferred@787474071 after retry RPC after error@1246336144) -> (continuation of Deferred@799444389 after retry RPC after error@1135620052) -> (continuation of Deferred@314225259 after retry RPC after error@340871608) -> (continuation of Deferred@251733298 after retry RPC after error@1301116297) -> (continuation of Deferred@174305209 after retry RPC after error@350305220) -> (continuation of Deferred@307213535 after retry RPC after error@885565986), errback=(continuation of Deferred@955615775 after retry RPC after error@777875132) -> (continuation of Deferred@1472997394 after retry RPC after error@544302619) -> (continuation of Deferred@885044600 after retry RPC after error@1907168722) -> (continuation of Deferred@1192701773 after retry RPC after error@1828575242) -> (continuation of Deferred@1571281816 after retry RPC after error@1153255035) -> (continuation of Deferred@976123110 after retry RPC after error@940688929) -> (continuation of Deferred@1535746464 after retry RPC after error@1965664820) -> (continuation of Deferred@1021933875 after retry RPC after error@176128065) -> (continuation of Deferred@476947471 after retry RPC after error@615368124) -> (continuation of Deferred@1400504571 after retry RPC after error@636612445) -> (continuation of Deferred@1414363696 after retry RPC after error@512214304) -> (continuation of Deferred@502887379 after retry RPC after error@936963126) -> (continuation of Deferred@150703111 after retry RPC after error@687208189) -> (continuation of Deferred@2126807003 after retry RPC after error@244159849) -> (continuation of Deferred@1514318603 after retry RPC after error@1569189024) -> (continuation of Deferred@14711404 after retry RPC after error@1646559684) -> (continuation of Deferred@770798712 after retry RPC after error@1332838282) -> (continuation of Deferred@1279352594 after retry RPC after error@179166719) -> (continuation of Deferred@744041062 after retry RPC after error@1745915208) -> (continuation of Deferred@787474071 after retry RPC after error@1246336144) -> (continuation of Deferred@799444389 after retry RPC after error@1135620052) -> (continuation of Deferred@314225259 after retry RPC after error@340871608) -> (continuation of Deferred@251733298 after retry RPC after error@1301116297) -> (continuation of Deferred@174305209 after retry RPC after error@350305220) -> (continuation of Deferred@307213535 after retry RPC after error@885565986)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.254:41393
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:07.004 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
23:49:07.004 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
23:49:07.004 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state RUNNING to RESTARTING.
23:49:07.007 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:07.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:07.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.025768 12155 tablet.cc:2406] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.042955 12280 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.043300 12280 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.045535 12280 leader_election.cc:290] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 409d65c7d361401fb2f015abf1527db6 (127.11.197.126:39201), 2ed8195727544d2e9a45a33cbd9c26ad (127.11.197.125:42079)
23:49:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.048130 12105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9252b3440bfb48468a8db2d35b6826f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "409d65c7d361401fb2f015abf1527db6" is_pre_election: true
23:49:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.048696 12105 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9252b3440bfb48468a8db2d35b6826f0 in term 0.
23:49:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.049486 12176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9252b3440bfb48468a8db2d35b6826f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" is_pre_election: true
23:49:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.050185 12176 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9252b3440bfb48468a8db2d35b6826f0 in term 0.
23:49:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.052886 12224 leader_election.cc:304] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed8195727544d2e9a45a33cbd9c26ad, 9252b3440bfb48468a8db2d35b6826f0; no voters: 
23:49:07.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468147057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:07.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.057777 12280 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:07.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.058017 12280 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:07.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.058352 12280 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 0 FOLLOWER]: Advancing to term 1
23:49:07.069 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:07.072 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
23:49:07.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.081111 12280 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.086063 12105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9252b3440bfb48468a8db2d35b6826f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "409d65c7d361401fb2f015abf1527db6"
23:49:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.086352 12105 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 0 FOLLOWER]: Advancing to term 1
23:49:07.092 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:07.092 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:07.093 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:07.093 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:07.093 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:07.093 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:07.093 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:07.093 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:07.093 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:07.093 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:07.093 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:07.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:07.094 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:07.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.090361 12176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9252b3440bfb48468a8db2d35b6826f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ed8195727544d2e9a45a33cbd9c26ad"
23:49:07.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.090657 12176 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 0 FOLLOWER]: Advancing to term 1
23:49:07.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.091197 12105 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9252b3440bfb48468a8db2d35b6826f0 in term 1.
23:49:07.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.091853 12222 leader_election.cc:304] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 409d65c7d361401fb2f015abf1527db6, 9252b3440bfb48468a8db2d35b6826f0; no voters: 
23:49:07.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.097215 12176 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9252b3440bfb48468a8db2d35b6826f0 in term 1.
23:49:07.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.098430 12280 leader_election.cc:290] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [CANDIDATE]: Term 1 election: Requested vote from peers 409d65c7d361401fb2f015abf1527db6 (127.11.197.126:39201), 2ed8195727544d2e9a45a33cbd9c26ad (127.11.197.125:42079)
23:49:07.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.099917 12280 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 1 FOLLOWER]: Leader election won for term 1
23:49:07.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.101405 12280 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [term 1 LEADER]: Becoming Leader. State: Replica: 9252b3440bfb48468a8db2d35b6826f0, State: Running, Role: LEADER
23:49:07.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.102119 12280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } }
23:49:07.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:07.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:07.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:07.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:07.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:07.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:07.109 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:07.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:07.109 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:07.108 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:07.110 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:07.110 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:07.110 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:07.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.113897 12321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9252b3440bfb48468a8db2d35b6826f0. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.114256 12321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: This master's current role is: LEADER
23:49:07.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:07.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:07.128 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:07.130 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:07.131 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:07.131 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:07.130 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:07.131 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:07.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:07.131 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:07.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:07.131 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:07.131 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:07.133 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27192), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [27ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [41ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [41ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [109ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [135ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [163ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [182ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [224ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [224ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [283ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [283ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [283ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [363ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [402ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [403ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [403ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [403ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [722ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [723ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [723ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [723ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [962ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [962ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [963ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [963ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [2202ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2202ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [4680ms] refreshing cache from master, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@1583279937(state=PENDING, result=null, callback=(continuation of Deferred@13998756 after retry RPC after error@1734740893) -> (continuation of Deferred@1460160880 after retry RPC after error@2122678327) -> (continuation of Deferred@1386817017 after retry RPC after error@88401618) -> (continuation of Deferred@269642947 after retry RPC after error@1111806670) -> (continuation of Deferred@1499046290 after retry RPC after error@2064231965) -> (continuation of Deferred@2029953483 after retry RPC after error@482922168) -> (continuation of Deferred@134850946 after retry RPC after error@1044809688) -> (continuation of Deferred@867932450 after retry RPC after error@1767652579) -> (continuation of Deferred@752672243 after retry RPC after error@640608247) -> (continuation of Deferred@1228081305 after retry RPC after error@1098944120) -> (continuation of Deferred@192536830 after retry RPC after error@1522118457) -> (continuation of Deferred@194970423 after retry RPC after error@1319743346) -> (continuation of Deferred@169068617 after retry RPC after error@499416661) -> (continuation of Deferred@1848725601 after retry RPC after error@1843437802) -> (continuation of Deferred@2040884383 after retry RPC after error@1194169128) -> (continuation of Deferred@603681268 after retry RPC after error@1274307217) -> (continuation of Deferred@434581220 after retry RPC after error@846744099) -> (continuation of Deferred@1257564489 after retry RPC after error@578615916) -> (continuation of Deferred@46952649 after retry RPC after error@1913986017) -> (continuation of Deferred@533072459 after retry RPC after error@1512848453), errback=(continuation of Deferred@13998756 after retry RPC after error@1734740893) -> (continuation of Deferred@1460160880 after retry RPC after error@2122678327) -> (continuation of Deferred@1386817017 after retry RPC after error@88401618) -> (continuation of Deferred@269642947 after retry RPC after error@1111806670) -> (continuation of Deferred@1499046290 after retry RPC after error@2064231965) -> (continuation of Deferred@2029953483 after retry RPC after error@482922168) -> (continuation of Deferred@134850946 after retry RPC after error@1044809688) -> (continuation of Deferred@867932450 after retry RPC after error@1767652579) -> (continuation of Deferred@752672243 after retry RPC after error@640608247) -> (continuation of Deferred@1228081305 after retry RPC after error@1098944120) -> (continuation of Deferred@192536830 after retry RPC after error@1522118457) -> (continuation of Deferred@194970423 after retry RPC after error@1319743346) -> (continuation of Deferred@169068617 after retry RPC after error@499416661) -> (continuation of Deferred@1848725601 after retry RPC after error@1843437802) -> (continuation of Deferred@2040884383 after retry RPC after error@1194169128) -> (continuation of Deferred@603681268 after retry RPC after error@1274307217) -> (continuation of Deferred@434581220 after retry RPC after error@846744099) -> (continuation of Deferred@1257564489 after retry RPC after error@578615916) -> (continuation of Deferred@46952649 after retry RPC after error@1913986017) -> (continuation of Deferred@533072459 after retry RPC after error@1512848453)))
23:49:07.133 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:07.134 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27192), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [27ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [41ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [41ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [109ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [135ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [163ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [182ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [224ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [224ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [283ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [283ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [283ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [363ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [402ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [403ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [403ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [403ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [722ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [723ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [723ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [723ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [962ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [962ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [963ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [963ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [2202ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2202ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [4680ms] refreshing cache from master, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@1583279937(state=PENDING, result=null, callback=(continuation of Deferred@13998756 after retry RPC after error@1734740893) -> (continuation of Deferred@1460160880 after retry RPC after error@2122678327) -> (continuation of Deferred@1386817017 after retry RPC after error@88401618) -> (continuation of Deferred@269642947 after retry RPC after error@1111806670) -> (continuation of Deferred@1499046290 after retry RPC after error@2064231965) -> (continuation of Deferred@2029953483 after retry RPC after error@482922168) -> (continuation of Deferred@134850946 after retry RPC after error@1044809688) -> (continuation of Deferred@867932450 after retry RPC after error@1767652579) -> (continuation of Deferred@752672243 after retry RPC after error@640608247) -> (continuation of Deferred@1228081305 after retry RPC after error@1098944120) -> (continuation of Deferred@192536830 after retry RPC after error@1522118457) -> (continuation of Deferred@194970423 after retry RPC after error@1319743346) -> (continuation of Deferred@169068617 after retry RPC after error@499416661) -> (continuation of Deferred@1848725601 after retry RPC after error@1843437802) -> (continuation of Deferred@2040884383 after retry RPC after error@1194169128) -> (continuation of Deferred@603681268 after retry RPC after error@1274307217) -> (continuation of Deferred@434581220 after retry RPC after error@846744099) -> (continuation of Deferred@1257564489 after retry RPC after error@578615916) -> (continuation of Deferred@46952649 after retry RPC after error@1913986017) -> (continuation of Deferred@533072459 after retry RPC after error@1512848453), errback=(continuation of Deferred@13998756 after retry RPC after error@1734740893) -> (continuation of Deferred@1460160880 after retry RPC after error@2122678327) -> (continuation of Deferred@1386817017 after retry RPC after error@88401618) -> (continuation of Deferred@269642947 after retry RPC after error@1111806670) -> (continuation of Deferred@1499046290 after retry RPC after error@2064231965) -> (continuation of Deferred@2029953483 after retry RPC after error@482922168) -> (continuation of Deferred@134850946 after retry RPC after error@1044809688) -> (continuation of Deferred@867932450 after retry RPC after error@1767652579) -> (continuation of Deferred@752672243 after retry RPC after error@640608247) -> (continuation of Deferred@1228081305 after retry RPC after error@1098944120) -> (continuation of Deferred@192536830 after retry RPC after error@1522118457) -> (continuation of Deferred@194970423 after retry RPC after error@1319743346) -> (continuation of Deferred@169068617 after retry RPC after error@499416661) -> (continuation of Deferred@1848725601 after retry RPC after error@1843437802) -> (continuation of Deferred@2040884383 after retry RPC after error@1194169128) -> (continuation of Deferred@603681268 after retry RPC after error@1274307217) -> (continuation of Deferred@434581220 after retry RPC after error@846744099) -> (continuation of Deferred@1257564489 after retry RPC after error@578615916) -> (continuation of Deferred@46952649 after retry RPC after error@1913986017) -> (continuation of Deferred@533072459 after retry RPC after error@1512848453)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.254:41393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:07.134 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
23:49:07.136 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
23:49:07.139 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27192), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [27ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [41ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [41ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [109ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [135ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [163ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [182ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [182ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [223ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [224ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [224ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [283ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [283ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [283ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [363ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [402ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [403ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [403ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [403ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [722ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [723ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [723ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [723ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [962ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [962ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [963ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [963ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [2202ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2202ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [4680ms] refreshing cache from master, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@1583279937(state=PENDING, result=null, callback=(continuation of Deferred@13998756 after retry RPC after error@1734740893) -> (continuation of Deferred@1460160880 after retry RPC after error@2122678327) -> (continuation of Deferred@1386817017 after retry RPC after error@88401618) -> (continuation of Deferred@269642947 after retry RPC after error@1111806670) -> (continuation of Deferred@1499046290 after retry RPC after error@2064231965) -> (continuation of Deferred@2029953483 after retry RPC after error@482922168) -> (continuation of Deferred@134850946 after retry RPC after error@1044809688) -> (continuation of Deferred@867932450 after retry RPC after error@1767652579) -> (continuation of Deferred@752672243 after retry RPC after error@640608247) -> (continuation of Deferred@1228081305 after retry RPC after error@1098944120) -> (continuation of Deferred@192536830 after retry RPC after error@1522118457) -> (continuation of Deferred@194970423 after retry RPC after error@1319743346) -> (continuation of Deferred@169068617 after retry RPC after error@499416661) -> (continuation of Deferred@1848725601 after retry RPC after error@1843437802) -> (continuation of Deferred@2040884383 after retry RPC after error@1194169128) -> (continuation of Deferred@603681268 after retry RPC after error@1274307217) -> (continuation of Deferred@434581220 after retry RPC after error@846744099) -> (continuation of Deferred@1257564489 after retry RPC after error@578615916) -> (continuation of Deferred@46952649 after retry RPC after error@1913986017) -> (continuation of Deferred@533072459 after retry RPC after error@1512848453), errback=(continuation of Deferred@13998756 after retry RPC after error@1734740893) -> (continuation of Deferred@1460160880 after retry RPC after error@2122678327) -> (continuation of Deferred@1386817017 after retry RPC after error@88401618) -> (continuation of Deferred@269642947 after retry RPC after error@1111806670) -> (continuation of Deferred@1499046290 after retry RPC after error@2064231965) -> (continuation of Deferred@2029953483 after retry RPC after error@482922168) -> (continuation of Deferred@134850946 after retry RPC after error@1044809688) -> (continuation of Deferred@867932450 after retry RPC after error@1767652579) -> (continuation of Deferred@752672243 after retry RPC after error@640608247) -> (continuation of Deferred@1228081305 after retry RPC after error@1098944120) -> (continuation of Deferred@192536830 after retry RPC after error@1522118457) -> (continuation of Deferred@194970423 after retry RPC after error@1319743346) -> (continuation of Deferred@169068617 after retry RPC after error@499416661) -> (continuation of Deferred@1848725601 after retry RPC after error@1843437802) -> (continuation of Deferred@2040884383 after retry RPC after error@1194169128) -> (continuation of Deferred@603681268 after retry RPC after error@1274307217) -> (continuation of Deferred@434581220 after retry RPC after error@846744099) -> (continuation of Deferred@1257564489 after retry RPC after error@578615916) -> (continuation of Deferred@46952649 after retry RPC after error@1913986017) -> (continuation of Deferred@533072459 after retry RPC after error@1512848453)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.254:41393
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:07.140 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:07.140 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
23:49:07.140 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
23:49:07.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.151926 12323 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:49:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.158046 12323 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:49:07.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.192155 12176 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [term 1 FOLLOWER]: Refusing update from remote peer 9252b3440bfb48468a8db2d35b6826f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:07.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.193807 12321 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:07.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.202785 12105 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [term 1 FOLLOWER]: Refusing update from remote peer 9252b3440bfb48468a8db2d35b6826f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:07.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.204785 12321 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:07.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:07.244 [DEBUG - pool-118-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30004), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: OK, deferred=null) with no deferred attached!
23:49:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.250937 12326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9252b3440bfb48468a8db2d35b6826f0. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.251824 12326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: This master's current role is: FOLLOWER
23:49:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.260231 12324 mvcc.cc:204] Tried to move back new op lower bound from 7305085530883801088 to 7305085530539880448. Current Snapshot: MvccSnapshot[applied={T|T < 7305085530883801088}]
23:49:07.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.261072 12308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9252b3440bfb48468a8db2d35b6826f0. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.261454 12308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: This master's current role is: FOLLOWER
23:49:07.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.267453 12321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.267771 12321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: This master's current role is: LEADER
23:49:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.268083 12321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.268297 12321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0 [sys.catalog]: This master's current role is: LEADER
23:49:07.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.269958 12323 catalog_manager.cc:1382] Generated new cluster ID: e49f25548c844caebe409ad9b47c4f90
23:49:07.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.270082 12323 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:49:07.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.274109 12327 mvcc.cc:204] Tried to move back new op lower bound from 7305085530883801088 to 7305085530539880448. Current Snapshot: MvccSnapshot[applied={T|T < 7305085530883801088}]
23:49:07.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.274669 12325 mvcc.cc:204] Tried to move back new op lower bound from 7305085530883801088 to 7305085530539880448. Current Snapshot: MvccSnapshot[applied={T|T < 7305085530883801088}]
23:49:07.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.286302 12308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.286561 12308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad [sys.catalog]: This master's current role is: FOLLOWER
23:49:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.296168 12326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9252b3440bfb48468a8db2d35b6826f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "409d65c7d361401fb2f015abf1527db6" member_type: VOTER last_known_addr { host: "127.11.197.126" port: 39201 } } peers { permanent_uuid: "2ed8195727544d2e9a45a33cbd9c26ad" member_type: VOTER last_known_addr { host: "127.11.197.125" port: 42079 } } peers { permanent_uuid: "9252b3440bfb48468a8db2d35b6826f0" member_type: VOTER last_known_addr { host: "127.11.197.124" port: 40009 } } }
23:49:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.296438 12326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6 [sys.catalog]: This master's current role is: FOLLOWER
23:49:07.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.304055 12323 catalog_manager.cc:1405] Generated new certificate authority record
23:49:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.305843 12323 catalog_manager.cc:1539] Loading token signing keys...
23:49:07.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.338559 12323 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 9252b3440bfb48468a8db2d35b6826f0: Generated new TSK 0
23:49:07.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.340312 12323 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:49:07.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468147369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:07.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.376713 12053 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:07.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:07.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal
23:49:07.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/logs
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data/info.pb
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.65:0
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.197.65
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.65
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:07.381 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:07.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
23:49:07.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:07.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468147557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:07.567 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:07.568 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
23:49:07.624 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:07.625 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:07.625 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:07.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:07.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:07.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:07.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:07.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:07.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:07.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:07.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:07.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:07.626 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:07.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.715176 12305 catalog_manager.cc:1294] Loaded cluster ID: e49f25548c844caebe409ad9b47c4f90
23:49:07.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.715323 12305 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: loading cluster ID for follower catalog manager: success
23:49:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.719883 12305 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: acquiring CA information for follower catalog manager: success
23:49:07.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:07.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.722981 12305 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 409d65c7d361401fb2f015abf1527db6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:07.726 [DEBUG - pool-122-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [4ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.783 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:07.784 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:07.784 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:07.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:07.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:07.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:07.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:07.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:07.784 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:07.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:07.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:07.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:07.785 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:07.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.789019 12333 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:07.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.789434 12333 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:07.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.789590 12333 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:07.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.799999 12333 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:07.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.800571 12333 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.197.65
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.813408 12333 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.65:0
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data/info.pb
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.65
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.197.65
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/logs
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:07.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:07.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.815430 12333 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:07.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.817595 12333 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:07.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.829236 12340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:07.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.829454 12342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:07.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:07.829312 12339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.832733 12333 server_base.cc:1061] running on GCE node
23:49:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.833514 12333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:07.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.834828 12333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:07.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.835390 12319 catalog_manager.cc:1294] Loaded cluster ID: e49f25548c844caebe409ad9b47c4f90
23:49:07.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.835521 12319 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: loading cluster ID for follower catalog manager: success
23:49:07.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.836310 12333 hybrid_clock.cc:648] HybridClock initialized: now 1783468147836239 us; error 61 us; skew 500 ppm
23:49:07.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.836687 12333 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:07.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.838546 12319 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: acquiring CA information for follower catalog manager: success
23:49:07.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.839406 12333 webserver.cc:534] Webserver started at http://127.11.197.65:37755/ using document root <none> and password file <none>
23:49:07.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.840193 12333 fs_manager.cc:362] Metadata directory not provided
23:49:07.840 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:07.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.840328 12333 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:07.840 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:07.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.840763 12333 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:07.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.840808 12319 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2ed8195727544d2e9a45a33cbd9c26ad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:07.841 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:07.840 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:07.841 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:07.841 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:07.841 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:07.841 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:07.841 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:07.841 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:07.841 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:07.841 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:07.841 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:07.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.844327 12333 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data/instance:
23:49:07.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:07.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:07 on dist-test-slave-hfsf"
23:49:07.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.845232 12333 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal/instance:
23:49:07.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:07.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:07 on dist-test-slave-hfsf"
23:49:07.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.851543 12333 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
23:49:07.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.855760 12348 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:07.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.857565 12333 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.857790 12333 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:07 on dist-test-slave-hfsf"
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.858058 12333 fs_report.cc:389] FS layout report
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data/data
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:07.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468147869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:07.880 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:07.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
23:49:07.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.883636 12333 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.884735 12333 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.885062 12333 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.888427 12333 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:07.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.890854 12333 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:07.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.891112 12333 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
23:49:07.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.891265 12333 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:07.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.891357 12333 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:07.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.933790 12333 rpc_server.cc:307] RPC server started. Bound to: 127.11.197.65:44387
23:49:07.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.933946 12460 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.197.65:44387 every 8 connection(s)
23:49:07.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.935578 12333 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/data/info.pb
23:49:07.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.941565 12053 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 12333
23:49:07.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.941792 12053 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-0/wal/instance
23:49:07.946 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [2ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.946 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [7ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.946 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [4ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.946 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [6ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.946 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [7ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.946 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.8.22.252:44235, [4ms] received response from server master-127.8.22.252:44235: OK, deferred=null) with no deferred attached!
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.948908 12053 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/logs
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data/info.pb
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.66:0
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.197.66
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.66
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:07.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:07.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:07.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.977571 12461 heartbeater.cc:344] Connected to a master server at 127.11.197.124:40009
23:49:07.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.977715 12462 heartbeater.cc:344] Connected to a master server at 127.11.197.126:39201
23:49:07.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.977965 12463 heartbeater.cc:344] Connected to a master server at 127.11.197.125:42079
23:49:07.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.978081 12461 heartbeater.cc:461] Registering TS with master...
23:49:07.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.978112 12463 heartbeater.cc:461] Registering TS with master...
23:49:07.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.978085 12462 heartbeater.cc:461] Registering TS with master...
23:49:07.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.979329 12463 heartbeater.cc:507] Master 127.11.197.125:42079 requested a full tablet report, sending...
23:49:07.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.979846 12462 heartbeater.cc:507] Master 127.11.197.126:39201 requested a full tablet report, sending...
23:49:07.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.980818 12461 heartbeater.cc:507] Master 127.11.197.124:40009 requested a full tablet report, sending...
23:49:07.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.982185 12094 ts_manager.cc:194] Registered new tserver with Master: b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387)
23:49:07.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.982185 12166 ts_manager.cc:194] Registered new tserver with Master: b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387)
23:49:07.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.982645 12238 ts_manager.cc:194] Registered new tserver with Master: b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387)
23:49:07.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:07.984563 12238 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.197.65:58671
23:49:08.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:08.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468148057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:08.085 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
23:49:08.086 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
23:49:08.136 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:08.137 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:08.137 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:08.137 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:08.137 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:08.137 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:08.137 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:08.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:08.137 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:08.138 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:08.138 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:08.138 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:08.138 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:08.139 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29545), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [5ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [16ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [18ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [18ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [49ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [50ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [57ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [81ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [82ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [83ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [104ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [105ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [106ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [106ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [122ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [164ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [164ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [223ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [345ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [346ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [347ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [347ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [623ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [623ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [624ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [624ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [642ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [642ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [643ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [643ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1064ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1904ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [4481ms] refreshing cache from master, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [4482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [4482ms] too many traces: truncated at 100 traces, deferred=Deferred@1805584946(state=PENDING, result=null, callback=(continuation of Deferred@1057065460 after retry RPC after error@991053099) -> (continuation of Deferred@1578285357 after retry RPC after error@1305474631) -> (continuation of Deferred@2117240867 after retry RPC after error@1461756371) -> (continuation of Deferred@481337803 after retry RPC after error@780079572) -> (continuation of Deferred@1155983272 after retry RPC after error@379255006) -> (continuation of Deferred@264092991 after retry RPC after error@1494936749) -> (continuation of Deferred@716344193 after retry RPC after error@1798294017) -> (continuation of Deferred@152688158 after retry RPC after error@124267540) -> (continuation of Deferred@968376827 after retry RPC after error@752024335) -> (continuation of Deferred@1807511981 after retry RPC after error@770893890) -> (continuation of Deferred@1455346590 after retry RPC after error@1829720261) -> (continuation of Deferred@1698063824 after retry RPC after error@1606169036) -> (continuation of Deferred@2134780806 after retry RPC after error@1746982364) -> (continuation of Deferred@1047410157 after retry RPC after error@6439357) -> (continuation of Deferred@244197420 after retry RPC after error@1626247700) -> (continuation of Deferred@803214009 after retry RPC after error@1025364305) -> (continuation of Deferred@1118650774 after retry RPC after error@1447499237) -> (continuation of Deferred@2031988814 after retry RPC after error@718893413) -> (continuation of Deferred@47195225 after retry RPC after error@1817633243) -> (continuation of Deferred@2019402719 after retry RPC after error@435070952) -> (continuation of Deferred@438282848 after retry RPC after error@1092409537) -> (continuation of Deferred@1422579814 after retry RPC after error@955770096) -> (continuation of Deferred@1608258852 after retry RPC after error@2015429838) -> (continuation of Deferred@2049636932 after retry RPC after error@2113753493), errback=(continuation of Deferred@1057065460 after retry RPC after error@991053099) -> (continuation of Deferred@1578285357 after retry RPC after error@1305474631) -> (continuation of Deferred@2117240867 after retry RPC after error@1461756371) -> (continuation of Deferred@481337803 after retry RPC after error@780079572) -> (continuation of Deferred@1155983272 after retry RPC after error@379255006) -> (continuation of Deferred@264092991 after retry RPC after error@1494936749) -> (continuation of Deferred@716344193 after retry RPC after error@1798294017) -> (continuation of Deferred@152688158 after retry RPC after error@124267540) -> (continuation of Deferred@968376827 after retry RPC after error@752024335) -> (continuation of Deferred@1807511981 after retry RPC after error@770893890) -> (continuation of Deferred@1455346590 after retry RPC after error@1829720261) -> (continuation of Deferred@1698063824 after retry RPC after error@1606169036) -> (continuation of Deferred@2134780806 after retry RPC after error@1746982364) -> (continuation of Deferred@1047410157 after retry RPC after error@6439357) -> (continuation of Deferred@244197420 after retry RPC after error@1626247700) -> (continuation of Deferred@803214009 after retry RPC after error@1025364305) -> (continuation of Deferred@1118650774 after retry RPC after error@1447499237) -> (continuation of Deferred@2031988814 after retry RPC after error@718893413) -> (continuation of Deferred@47195225 after retry RPC after error@1817633243) -> (continuation of Deferred@2019402719 after retry RPC after error@435070952) -> (continuation of Deferred@438282848 after retry RPC after error@1092409537) -> (continuation of Deferred@1422579814 after retry RPC after error@955770096) -> (continuation of Deferred@1608258852 after retry RPC after error@2015429838) -> (continuation of Deferred@2049636932 after retry RPC after error@2113753493)))
23:49:08.139 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:08.140 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29545), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [5ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [16ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [18ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [18ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [49ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [50ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [57ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [81ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [82ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [83ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [104ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [105ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [106ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [106ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [122ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [164ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [164ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [223ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [345ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [346ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [347ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [347ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [623ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [623ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [624ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [624ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [642ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [642ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [643ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [643ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1064ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1904ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [4481ms] refreshing cache from master, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [4482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [4482ms] too many traces: truncated at 100 traces, deferred=Deferred@1805584946(state=PENDING, result=null, callback=(continuation of Deferred@1057065460 after retry RPC after error@991053099) -> (continuation of Deferred@1578285357 after retry RPC after error@1305474631) -> (continuation of Deferred@2117240867 after retry RPC after error@1461756371) -> (continuation of Deferred@481337803 after retry RPC after error@780079572) -> (continuation of Deferred@1155983272 after retry RPC after error@379255006) -> (continuation of Deferred@264092991 after retry RPC after error@1494936749) -> (continuation of Deferred@716344193 after retry RPC after error@1798294017) -> (continuation of Deferred@152688158 after retry RPC after error@124267540) -> (continuation of Deferred@968376827 after retry RPC after error@752024335) -> (continuation of Deferred@1807511981 after retry RPC after error@770893890) -> (continuation of Deferred@1455346590 after retry RPC after error@1829720261) -> (continuation of Deferred@1698063824 after retry RPC after error@1606169036) -> (continuation of Deferred@2134780806 after retry RPC after error@1746982364) -> (continuation of Deferred@1047410157 after retry RPC after error@6439357) -> (continuation of Deferred@244197420 after retry RPC after error@1626247700) -> (continuation of Deferred@803214009 after retry RPC after error@1025364305) -> (continuation of Deferred@1118650774 after retry RPC after error@1447499237) -> (continuation of Deferred@2031988814 after retry RPC after error@718893413) -> (continuation of Deferred@47195225 after retry RPC after error@1817633243) -> (continuation of Deferred@2019402719 after retry RPC after error@435070952) -> (continuation of Deferred@438282848 after retry RPC after error@1092409537) -> (continuation of Deferred@1422579814 after retry RPC after error@955770096) -> (continuation of Deferred@1608258852 after retry RPC after error@2015429838) -> (continuation of Deferred@2049636932 after retry RPC after error@2113753493), errback=(continuation of Deferred@1057065460 after retry RPC after error@991053099) -> (continuation of Deferred@1578285357 after retry RPC after error@1305474631) -> (continuation of Deferred@2117240867 after retry RPC after error@1461756371) -> (continuation of Deferred@481337803 after retry RPC after error@780079572) -> (continuation of Deferred@1155983272 after retry RPC after error@379255006) -> (continuation of Deferred@264092991 after retry RPC after error@1494936749) -> (continuation of Deferred@716344193 after retry RPC after error@1798294017) -> (continuation of Deferred@152688158 after retry RPC after error@124267540) -> (continuation of Deferred@968376827 after retry RPC after error@752024335) -> (continuation of Deferred@1807511981 after retry RPC after error@770893890) -> (continuation of Deferred@1455346590 after retry RPC after error@1829720261) -> (continuation of Deferred@1698063824 after retry RPC after error@1606169036) -> (continuation of Deferred@2134780806 after retry RPC after error@1746982364) -> (continuation of Deferred@1047410157 after retry RPC after error@6439357) -> (continuation of Deferred@244197420 after retry RPC after error@1626247700) -> (continuation of Deferred@803214009 after retry RPC after error@1025364305) -> (continuation of Deferred@1118650774 after retry RPC after error@1447499237) -> (continuation of Deferred@2031988814 after retry RPC after error@718893413) -> (continuation of Deferred@47195225 after retry RPC after error@1817633243) -> (continuation of Deferred@2019402719 after retry RPC after error@435070952) -> (continuation of Deferred@438282848 after retry RPC after error@1092409537) -> (continuation of Deferred@1422579814 after retry RPC after error@955770096) -> (continuation of Deferred@1608258852 after retry RPC after error@2015429838) -> (continuation of Deferred@2049636932 after retry RPC after error@2113753493)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.253:38083
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:08.140 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
23:49:08.142 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
23:49:08.144 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29545), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [5ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [16ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [18ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [18ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [49ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [50ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [57ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [81ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [82ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [83ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [104ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [105ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [106ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [106ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [122ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [164ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [164ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [223ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [345ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [346ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [347ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [347ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [623ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [623ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [624ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [624ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [642ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [642ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [643ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [643ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1064ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1901ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1904ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [4481ms] refreshing cache from master, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [4481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [4482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [4482ms] too many traces: truncated at 100 traces, deferred=Deferred@1805584946(state=PENDING, result=null, callback=(continuation of Deferred@1057065460 after retry RPC after error@991053099) -> (continuation of Deferred@1578285357 after retry RPC after error@1305474631) -> (continuation of Deferred@2117240867 after retry RPC after error@1461756371) -> (continuation of Deferred@481337803 after retry RPC after error@780079572) -> (continuation of Deferred@1155983272 after retry RPC after error@379255006) -> (continuation of Deferred@264092991 after retry RPC after error@1494936749) -> (continuation of Deferred@716344193 after retry RPC after error@1798294017) -> (continuation of Deferred@152688158 after retry RPC after error@124267540) -> (continuation of Deferred@968376827 after retry RPC after error@752024335) -> (continuation of Deferred@1807511981 after retry RPC after error@770893890) -> (continuation of Deferred@1455346590 after retry RPC after error@1829720261) -> (continuation of Deferred@1698063824 after retry RPC after error@1606169036) -> (continuation of Deferred@2134780806 after retry RPC after error@1746982364) -> (continuation of Deferred@1047410157 after retry RPC after error@6439357) -> (continuation of Deferred@244197420 after retry RPC after error@1626247700) -> (continuation of Deferred@803214009 after retry RPC after error@1025364305) -> (continuation of Deferred@1118650774 after retry RPC after error@1447499237) -> (continuation of Deferred@2031988814 after retry RPC after error@718893413) -> (continuation of Deferred@47195225 after retry RPC after error@1817633243) -> (continuation of Deferred@2019402719 after retry RPC after error@435070952) -> (continuation of Deferred@438282848 after retry RPC after error@1092409537) -> (continuation of Deferred@1422579814 after retry RPC after error@955770096) -> (continuation of Deferred@1608258852 after retry RPC after error@2015429838) -> (continuation of Deferred@2049636932 after retry RPC after error@2113753493), errback=(continuation of Deferred@1057065460 after retry RPC after error@991053099) -> (continuation of Deferred@1578285357 after retry RPC after error@1305474631) -> (continuation of Deferred@2117240867 after retry RPC after error@1461756371) -> (continuation of Deferred@481337803 after retry RPC after error@780079572) -> (continuation of Deferred@1155983272 after retry RPC after error@379255006) -> (continuation of Deferred@264092991 after retry RPC after error@1494936749) -> (continuation of Deferred@716344193 after retry RPC after error@1798294017) -> (continuation of Deferred@152688158 after retry RPC after error@124267540) -> (continuation of Deferred@968376827 after retry RPC after error@752024335) -> (continuation of Deferred@1807511981 after retry RPC after error@770893890) -> (continuation of Deferred@1455346590 after retry RPC after error@1829720261) -> (continuation of Deferred@1698063824 after retry RPC after error@1606169036) -> (continuation of Deferred@2134780806 after retry RPC after error@1746982364) -> (continuation of Deferred@1047410157 after retry RPC after error@6439357) -> (continuation of Deferred@244197420 after retry RPC after error@1626247700) -> (continuation of Deferred@803214009 after retry RPC after error@1025364305) -> (continuation of Deferred@1118650774 after retry RPC after error@1447499237) -> (continuation of Deferred@2031988814 after retry RPC after error@718893413) -> (continuation of Deferred@47195225 after retry RPC after error@1817633243) -> (continuation of Deferred@2019402719 after retry RPC after error@435070952) -> (continuation of Deferred@438282848 after retry RPC after error@1092409537) -> (continuation of Deferred@1422579814 after retry RPC after error@955770096) -> (continuation of Deferred@1608258852 after retry RPC after error@2015429838) -> (continuation of Deferred@2049636932 after retry RPC after error@2113753493)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.253:38083
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:08.145 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
23:49:08.146 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
23:49:08.146 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:08.183 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:08.184 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:08.184 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:08.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:08.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:08.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:08.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:08.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:08.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:08.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:08.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:08.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:08.184 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:08.185 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [39ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [49ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [49ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [71ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [73ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [121ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [142ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [142ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [162ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [264ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [342ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [343ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [343ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [383ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [383ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [383ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [862ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [862ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [882ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [882ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [882ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1163ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2260ms] refreshing cache from master, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [2261ms] too many traces: truncated at 100 traces, deferred=Deferred@2049672567(state=PENDING, result=null, callback=(continuation of Deferred@107759114 after retry RPC after error@1743424962) -> (continuation of Deferred@233250694 after retry RPC after error@734077808) -> (continuation of Deferred@1341746196 after retry RPC after error@2093907124) -> (continuation of Deferred@1239439236 after retry RPC after error@1796749163) -> (continuation of Deferred@1862631376 after retry RPC after error@1621198168) -> (continuation of Deferred@725004991 after retry RPC after error@29326301) -> (continuation of Deferred@1157660613 after retry RPC after error@694663544) -> (continuation of Deferred@928662945 after retry RPC after error@1304539396) -> (continuation of Deferred@192479534 after retry RPC after error@524404032) -> (continuation of Deferred@2060713028 after retry RPC after error@978992011) -> (continuation of Deferred@2036940191 after retry RPC after error@1746115639) -> (continuation of Deferred@222788781 after retry RPC after error@1714067693) -> (continuation of Deferred@1453311090 after retry RPC after error@580454578) -> (continuation of Deferred@336443992 after retry RPC after error@642950596) -> (continuation of Deferred@247879976 after retry RPC after error@1693453530) -> (continuation of Deferred@492217702 after retry RPC after error@773414797) -> (continuation of Deferred@313150591 after retry RPC after error@1993872428) -> (continuation of Deferred@1577972228 after retry RPC after error@973880191) -> (continuation of Deferred@2047164917 after retry RPC after error@1288328173) -> (continuation of Deferred@2112230818 after retry RPC after error@644488866) -> (continuation of Deferred@1991305587 after retry RPC after error@1761315187) -> (continuation of Deferred@629000907 after retry RPC after error@1393840072) -> (continuation of Deferred@572444584 after retry RPC after error@370834057) -> (continuation of Deferred@1568325907 after retry RPC after error@752988027) -> (continuation of Deferred@2027312832 after retry RPC after error@1037940065), errback=(continuation of Deferred@107759114 after retry RPC after error@1743424962) -> (continuation of Deferred@233250694 after retry RPC after error@734077808) -> (continuation of Deferred@1341746196 after retry RPC after error@2093907124) -> (continuation of Deferred@1239439236 after retry RPC after error@1796749163) -> (continuation of Deferred@1862631376 after retry RPC after error@1621198168) -> (continuation of Deferred@725004991 after retry RPC after error@29326301) -> (continuation of Deferred@1157660613 after retry RPC after error@694663544) -> (continuation of Deferred@928662945 after retry RPC after error@1304539396) -> (continuation of Deferred@192479534 after retry RPC after error@524404032) -> (continuation of Deferred@2060713028 after retry RPC after error@978992011) -> (continuation of Deferred@2036940191 after retry RPC after error@1746115639) -> (continuation of Deferred@222788781 after retry RPC after error@1714067693) -> (continuation of Deferred@1453311090 after retry RPC after error@580454578) -> (continuation of Deferred@336443992 after retry RPC after error@642950596) -> (continuation of Deferred@247879976 after retry RPC after error@1693453530) -> (continuation of Deferred@492217702 after retry RPC after error@773414797) -> (continuation of Deferred@313150591 after retry RPC after error@1993872428) -> (continuation of Deferred@1577972228 after retry RPC after error@973880191) -> (continuation of Deferred@2047164917 after retry RPC after error@1288328173) -> (continuation of Deferred@2112230818 after retry RPC after error@644488866) -> (continuation of Deferred@1991305587 after retry RPC after error@1761315187) -> (continuation of Deferred@629000907 after retry RPC after error@1393840072) -> (continuation of Deferred@572444584 after retry RPC after error@370834057) -> (continuation of Deferred@1568325907 after retry RPC after error@752988027) -> (continuation of Deferred@2027312832 after retry RPC after error@1037940065)))
23:49:08.186 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:08.186 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [39ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [49ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [49ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [71ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [73ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [121ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [142ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [142ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [162ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [264ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [342ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [343ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [343ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [383ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [383ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [383ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [862ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [862ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [882ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [882ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [882ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1163ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2260ms] refreshing cache from master, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [2261ms] too many traces: truncated at 100 traces, deferred=Deferred@2049672567(state=PENDING, result=null, callback=(continuation of Deferred@107759114 after retry RPC after error@1743424962) -> (continuation of Deferred@233250694 after retry RPC after error@734077808) -> (continuation of Deferred@1341746196 after retry RPC after error@2093907124) -> (continuation of Deferred@1239439236 after retry RPC after error@1796749163) -> (continuation of Deferred@1862631376 after retry RPC after error@1621198168) -> (continuation of Deferred@725004991 after retry RPC after error@29326301) -> (continuation of Deferred@1157660613 after retry RPC after error@694663544) -> (continuation of Deferred@928662945 after retry RPC after error@1304539396) -> (continuation of Deferred@192479534 after retry RPC after error@524404032) -> (continuation of Deferred@2060713028 after retry RPC after error@978992011) -> (continuation of Deferred@2036940191 after retry RPC after error@1746115639) -> (continuation of Deferred@222788781 after retry RPC after error@1714067693) -> (continuation of Deferred@1453311090 after retry RPC after error@580454578) -> (continuation of Deferred@336443992 after retry RPC after error@642950596) -> (continuation of Deferred@247879976 after retry RPC after error@1693453530) -> (continuation of Deferred@492217702 after retry RPC after error@773414797) -> (continuation of Deferred@313150591 after retry RPC after error@1993872428) -> (continuation of Deferred@1577972228 after retry RPC after error@973880191) -> (continuation of Deferred@2047164917 after retry RPC after error@1288328173) -> (continuation of Deferred@2112230818 after retry RPC after error@644488866) -> (continuation of Deferred@1991305587 after retry RPC after error@1761315187) -> (continuation of Deferred@629000907 after retry RPC after error@1393840072) -> (continuation of Deferred@572444584 after retry RPC after error@370834057) -> (continuation of Deferred@1568325907 after retry RPC after error@752988027) -> (continuation of Deferred@2027312832 after retry RPC after error@1037940065), errback=(continuation of Deferred@107759114 after retry RPC after error@1743424962) -> (continuation of Deferred@233250694 after retry RPC after error@734077808) -> (continuation of Deferred@1341746196 after retry RPC after error@2093907124) -> (continuation of Deferred@1239439236 after retry RPC after error@1796749163) -> (continuation of Deferred@1862631376 after retry RPC after error@1621198168) -> (continuation of Deferred@725004991 after retry RPC after error@29326301) -> (continuation of Deferred@1157660613 after retry RPC after error@694663544) -> (continuation of Deferred@928662945 after retry RPC after error@1304539396) -> (continuation of Deferred@192479534 after retry RPC after error@524404032) -> (continuation of Deferred@2060713028 after retry RPC after error@978992011) -> (continuation of Deferred@2036940191 after retry RPC after error@1746115639) -> (continuation of Deferred@222788781 after retry RPC after error@1714067693) -> (continuation of Deferred@1453311090 after retry RPC after error@580454578) -> (continuation of Deferred@336443992 after retry RPC after error@642950596) -> (continuation of Deferred@247879976 after retry RPC after error@1693453530) -> (continuation of Deferred@492217702 after retry RPC after error@773414797) -> (continuation of Deferred@313150591 after retry RPC after error@1993872428) -> (continuation of Deferred@1577972228 after retry RPC after error@973880191) -> (continuation of Deferred@2047164917 after retry RPC after error@1288328173) -> (continuation of Deferred@2112230818 after retry RPC after error@644488866) -> (continuation of Deferred@1991305587 after retry RPC after error@1761315187) -> (continuation of Deferred@629000907 after retry RPC after error@1393840072) -> (continuation of Deferred@572444584 after retry RPC after error@370834057) -> (continuation of Deferred@1568325907 after retry RPC after error@752988027) -> (continuation of Deferred@2027312832 after retry RPC after error@1037940065)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.254:41393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:08.187 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
23:49:08.188 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
23:49:08.191 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [39ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [49ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [49ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [71ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [73ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [121ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [142ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [142ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [162ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [264ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [342ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [343ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [343ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [383ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [383ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [383ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [862ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [862ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [882ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [882ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [882ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.252:44265: Network error: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.253:38083: Network error: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.4.149.254:41393: Network error: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [1163ms] delaying RPC due to: Service unavailable: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393, [2260ms] refreshing cache from master, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.252:44265, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.253:38083, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.149.254:41393, [2261ms] too many traces: truncated at 100 traces, deferred=Deferred@2049672567(state=PENDING, result=null, callback=(continuation of Deferred@107759114 after retry RPC after error@1743424962) -> (continuation of Deferred@233250694 after retry RPC after error@734077808) -> (continuation of Deferred@1341746196 after retry RPC after error@2093907124) -> (continuation of Deferred@1239439236 after retry RPC after error@1796749163) -> (continuation of Deferred@1862631376 after retry RPC after error@1621198168) -> (continuation of Deferred@725004991 after retry RPC after error@29326301) -> (continuation of Deferred@1157660613 after retry RPC after error@694663544) -> (continuation of Deferred@928662945 after retry RPC after error@1304539396) -> (continuation of Deferred@192479534 after retry RPC after error@524404032) -> (continuation of Deferred@2060713028 after retry RPC after error@978992011) -> (continuation of Deferred@2036940191 after retry RPC after error@1746115639) -> (continuation of Deferred@222788781 after retry RPC after error@1714067693) -> (continuation of Deferred@1453311090 after retry RPC after error@580454578) -> (continuation of Deferred@336443992 after retry RPC after error@642950596) -> (continuation of Deferred@247879976 after retry RPC after error@1693453530) -> (continuation of Deferred@492217702 after retry RPC after error@773414797) -> (continuation of Deferred@313150591 after retry RPC after error@1993872428) -> (continuation of Deferred@1577972228 after retry RPC after error@973880191) -> (continuation of Deferred@2047164917 after retry RPC after error@1288328173) -> (continuation of Deferred@2112230818 after retry RPC after error@644488866) -> (continuation of Deferred@1991305587 after retry RPC after error@1761315187) -> (continuation of Deferred@629000907 after retry RPC after error@1393840072) -> (continuation of Deferred@572444584 after retry RPC after error@370834057) -> (continuation of Deferred@1568325907 after retry RPC after error@752988027) -> (continuation of Deferred@2027312832 after retry RPC after error@1037940065), errback=(continuation of Deferred@107759114 after retry RPC after error@1743424962) -> (continuation of Deferred@233250694 after retry RPC after error@734077808) -> (continuation of Deferred@1341746196 after retry RPC after error@2093907124) -> (continuation of Deferred@1239439236 after retry RPC after error@1796749163) -> (continuation of Deferred@1862631376 after retry RPC after error@1621198168) -> (continuation of Deferred@725004991 after retry RPC after error@29326301) -> (continuation of Deferred@1157660613 after retry RPC after error@694663544) -> (continuation of Deferred@928662945 after retry RPC after error@1304539396) -> (continuation of Deferred@192479534 after retry RPC after error@524404032) -> (continuation of Deferred@2060713028 after retry RPC after error@978992011) -> (continuation of Deferred@2036940191 after retry RPC after error@1746115639) -> (continuation of Deferred@222788781 after retry RPC after error@1714067693) -> (continuation of Deferred@1453311090 after retry RPC after error@580454578) -> (continuation of Deferred@336443992 after retry RPC after error@642950596) -> (continuation of Deferred@247879976 after retry RPC after error@1693453530) -> (continuation of Deferred@492217702 after retry RPC after error@773414797) -> (continuation of Deferred@313150591 after retry RPC after error@1993872428) -> (continuation of Deferred@1577972228 after retry RPC after error@973880191) -> (continuation of Deferred@2047164917 after retry RPC after error@1288328173) -> (continuation of Deferred@2112230818 after retry RPC after error@644488866) -> (continuation of Deferred@1991305587 after retry RPC after error@1761315187) -> (continuation of Deferred@629000907 after retry RPC after error@1393840072) -> (continuation of Deferred@572444584 after retry RPC after error@370834057) -> (continuation of Deferred@1568325907 after retry RPC after error@752988027) -> (continuation of Deferred@2027312832 after retry RPC after error@1037940065)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.149.254:41393
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:08.192 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
23:49:08.192 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
23:49:08.193 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6446e0085b210020482ce7a622d23630
23:49:08.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:08.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.357257 12471 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:08.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.357576 12471 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:08.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.357658 12471 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:08.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.367281 12471 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:08.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.367442 12471 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.197.66
23:49:08.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468148369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:08.376 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:08.376 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:08.377 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:08.377 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:49:08.377 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:08.377 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:08.377 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:08.377 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:08.377 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:08.377 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:08.378 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:08.378 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:08.378 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:08.378 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:08.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.381490 12471 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.66:0
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data/info.pb
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.66
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.197.66
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/logs
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:08.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:08.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.383324 12471 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.385243 12471 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:08.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.395628 12477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:08.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.396999 12476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:08.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.397508 12479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:08.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.399099 12471 server_base.cc:1061] running on GCE node
23:49:08.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.399818 12471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:08.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.400921 12471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:08.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.402156 12471 hybrid_clock.cc:648] HybridClock initialized: now 1783468148402069 us; error 78 us; skew 500 ppm
23:49:08.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.402531 12471 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:08.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.405584 12471 webserver.cc:534] Webserver started at http://127.11.197.66:36183/ using document root <none> and password file <none>
23:49:08.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.406396 12471 fs_manager.cc:362] Metadata directory not provided
23:49:08.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.406490 12471 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:08.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.406934 12471 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.409560 12471 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data/instance:
23:49:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:08 on dist-test-slave-hfsf"
23:49:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.410370 12471 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal/instance:
23:49:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:08.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:08 on dist-test-slave-hfsf"
23:49:08.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.416603 12471 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
23:49:08.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.420533 12485 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.422022 12471 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.422165 12471 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:08 on dist-test-slave-hfsf"
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.422346 12471 fs_report.cc:389] FS layout report
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data/data
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.442462 12471 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.444024 12471 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.444314 12471 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.445499 12471 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.447357 12471 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.447464 12471 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.447543 12471 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.447603 12471 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:08.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.500314 12471 rpc_server.cc:307] RPC server started. Bound to: 127.11.197.66:41585
23:49:08.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.500330 12598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.197.66:41585 every 8 connection(s)
23:49:08.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.502169 12471 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/data/info.pb
23:49:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.510552 12053 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 12471
23:49:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.510860 12053 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-1/wal/instance
23:49:08.513 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.516209 12053 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/logs
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data/info.pb
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.67:0
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.197.67
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.67
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:08.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.542615 12599 heartbeater.cc:344] Connected to a master server at 127.11.197.124:40009
23:49:08.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.543082 12599 heartbeater.cc:461] Registering TS with master...
23:49:08.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.544468 12599 heartbeater.cc:507] Master 127.11.197.124:40009 requested a full tablet report, sending...
23:49:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.546626 12238 ts_manager.cc:194] Registered new tserver with Master: 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:08.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.547611 12238 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.197.66:41977
23:49:08.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468148557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.565049 12601 heartbeater.cc:344] Connected to a master server at 127.11.197.125:42079
23:49:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.565256 12601 heartbeater.cc:461] Registering TS with master...
23:49:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.565723 12601 heartbeater.cc:507] Master 127.11.197.125:42079 requested a full tablet report, sending...
23:49:08.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.567790 12166 ts_manager.cc:194] Registered new tserver with Master: 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:08.572 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
23:49:08.572 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
23:49:08.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.577775 12600 heartbeater.cc:344] Connected to a master server at 127.11.197.126:39201
23:49:08.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.577984 12600 heartbeater.cc:461] Registering TS with master...
23:49:08.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.578310 12600 heartbeater.cc:507] Master 127.11.197.126:39201 requested a full tablet report, sending...
23:49:08.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.579792 12094 ts_manager.cc:194] Registered new tserver with Master: 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:08.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:08.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468148869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:08.880 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:08.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
23:49:08.916 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:08.916 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:08.916 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:08.916 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:08.916 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:08.917 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:08.917 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:08.917 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:08.917 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:08.917 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:08.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:08.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:08.918 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.954269 12609 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.954698 12609 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:08.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.954878 12609 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.965397 12609 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.965651 12609 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.197.67
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.978099 12609 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.197.84:41699
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.197.67:0
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data/info.pb
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.197.67
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.197.126:39201,127.11.197.125:42079,127.11.197.124:40009
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:08.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.197.67
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/logs
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:08.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.980345 12609 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:08.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.982389 12609 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:08.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:08.989480 12461 heartbeater.cc:499] Master 127.11.197.124:40009 was elected leader, sending a full tablet report...
23:49:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.995617 12614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:08.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:08.996934 12615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:09.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.002014 12617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.002847 12609 server_base.cc:1061] running on GCE node
23:49:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.003823 12609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.005215 12609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:09.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.006487 12609 hybrid_clock.cc:648] HybridClock initialized: now 1783468149006384 us; error 72 us; skew 500 ppm
23:49:09.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.007056 12609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:09.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.009944 12609 webserver.cc:534] Webserver started at http://127.11.197.67:37653/ using document root <none> and password file <none>
23:49:09.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.010965 12609 fs_manager.cc:362] Metadata directory not provided
23:49:09.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.011145 12609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:09.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:09.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.011601 12609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:09.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.014380 12609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data/instance:
23:49:09.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7878f56361a947c08732561c97ca3165"
23:49:09.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:09 on dist-test-slave-hfsf"
23:49:09.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.015391 12609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal/instance:
23:49:09.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7878f56361a947c08732561c97ca3165"
23:49:09.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:09 on dist-test-slave-hfsf"
23:49:09.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.021606 12609 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
23:49:09.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.025611 12623 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.027184 12609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.027379 12609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7878f56361a947c08732561c97ca3165"
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:09 on dist-test-slave-hfsf"
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.027657 12609 fs_report.cc:389] FS layout report
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal
23:49:09.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data/data
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:09.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:09.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.049259 12609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.050429 12609 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:09.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.050827 12609 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:09.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.051975 12609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:09.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.053938 12609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:09.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.054076 12609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:09.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.054200 12609 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:09.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.054309 12609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:09.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468149057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:09.071 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:49:09.074 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
23:49:09.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:09.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:09.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:09.108 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:09.108 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:09.109 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:09.109 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:09.109 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:09.109 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:09.110 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:09.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:09.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:09.110 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:09.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.116973 12609 rpc_server.cc:307] RPC server started. Bound to: 127.11.197.67:46441
23:49:09.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.117070 12737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.197.67:46441 every 8 connection(s)
23:49:09.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.118654 12609 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/data/info.pb
23:49:09.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.126322 12053 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 12609
23:49:09.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.126513 12053 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16914356916221625837/ts-2/wal/instance
23:49:09.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.139876 12738 heartbeater.cc:344] Connected to a master server at 127.11.197.124:40009
23:49:09.140 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:09.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.140352 12738 heartbeater.cc:461] Registering TS with master...
23:49:09.140 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:09.140 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:09.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:09.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:09.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:09.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.141642 12738 heartbeater.cc:507] Master 127.11.197.124:40009 requested a full tablet report, sending...
23:49:09.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:09.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:09.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:09.143 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:09.143 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:09.143 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:09.143 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:09.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.144503 12237 ts_manager.cc:194] Registered new tserver with Master: 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:09.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.146462 12237 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.197.67:41431
23:49:09.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.147522 12739 heartbeater.cc:344] Connected to a master server at 127.11.197.126:39201
23:49:09.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.147716 12739 heartbeater.cc:461] Registering TS with master...
23:49:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.148591 12739 heartbeater.cc:507] Master 127.11.197.126:39201 requested a full tablet report, sending...
23:49:09.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.149879 12094 ts_manager.cc:194] Registered new tserver with Master: 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:09.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.150419 12740 heartbeater.cc:344] Connected to a master server at 127.11.197.125:42079
23:49:09.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.150595 12740 heartbeater.cc:461] Registering TS with master...
23:49:09.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.151046 12740 heartbeater.cc:507] Master 127.11.197.125:42079 requested a full tablet report, sending...
23:49:09.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.152067 12166 ts_manager.cc:194] Registered new tserver with Master: 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.163968 12053 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:49:09.166 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:09.166 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:49:09.167 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.197.126"
      port: 39201
    }
    bound_http_address {
      host: "127.11.197.126"
      port: 38277
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.197.125"
      port: 42079
    }
    bound_http_address {
      host: "127.11.197.125"
      port: 37243
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.197.124"
      port: 40009
    }
    bound_http_address {
      host: "127.11.197.124"
      port: 36829
    }
  }
}

23:49:09.167 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:49:09.168 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.197.65"
      port: 44387
    }
    bound_http_address {
      host: "127.11.197.65"
      port: 37755
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.197.66"
      port: 41585
    }
    bound_http_address {
      host: "127.11.197.66"
      port: 36183
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.197.67"
      port: 46441
    }
    bound_http_address {
      host: "127.11.197.67"
      port: 37653
    }
  }
}

23:49:09.168 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:49:09.170 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:09.171 [DEBUG - main] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:09.172 [DEBUG - main] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:09.173 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.23.253:46397(127.11.23.253:46397)] Successfully connected to peer
23:49:09.173 [DEBUG - main] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:09.175 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.23.254:41819(127.11.23.254:41819)] Successfully connected to peer
23:49:09.176 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.23.252:40791(127.11.23.252:40791)] Successfully connected to peer
23:49:09.177 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:49:09.177 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.252
23:49:09.177 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.254
23:49:09.178 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
23:49:09.178 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
23:49:09.178 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:49:09.179 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
23:49:09.179 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id 2750b63c4d5504ec57bd2f23b98fae74
23:49:09.180 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:49:09.180 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
23:49:09.180 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:49:09.181 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
23:49:09.181 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:09.181 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2750b63c4d5504ec57bd2f23b98fae74.
23:49:09.181 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:09.181 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
23:49:09.182 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id be7a18e0c9338df241a38b6571839023
23:49:09.183 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:49:09.183 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
23:49:09.184 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:49:09.182 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 2750b63c4d5504ec57bd2f23b98fae74.
23:49:09.184 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
23:49:09.184 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:09.185 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
23:49:09.185 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id 9eb4051c1a4055e19a4fd12d5e8e0fbb
23:49:09.185 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:09.185 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:09.185 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6446e0085b210020482ce7a622d23630) switched from state RESTARTING to RUNNING.
23:49:09.185 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:09.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:09.186 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:09.186 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:09.186 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:09.186 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:09.186 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 6446e0085b210020482ce7a622d23630 from Checkpoint 65 @ 1783468117091 for 6446e0085b210020482ce7a622d23630 located at file:/tmp/junit7130890347027730205/checkpoints/6446e0085b210020482ce7a622d23630/chk-65.
23:49:09.186 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:09.187 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:09.187 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:09.187 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:09.184 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:09.188 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:09.188 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot be7a18e0c9338df241a38b6571839023.
23:49:09.189 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
23:49:09.189 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 65 for source Source: KuduSource to checkpoint.
23:49:09.189 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id be7a18e0c9338df241a38b6571839023.
23:49:09.190 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
23:49:09.190 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6446e0085b210020482ce7a622d23630: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:09.192 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
23:49:09.192 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6a4ff6de-0b40-443a-bf4f-80ffab5e2470 @ 127.0.0.1 (dataPort=-1) with allocation id dc06bb8446b4d03ecd66cf0d840502e8
23:49:09.192 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0eb4ee0c, L:/127.0.0.1:49828 - R:/127.11.23.252:40791] using SASL/PLAIN
23:49:09.193 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
23:49:09.193 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
23:49:09.197 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:09.198 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@40b44bd7
23:49:09.199 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:09.199 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:49:09.199 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
23:49:09.200 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
23:49:09.200 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.253
23:49:09.200 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfb3ebc45, L:/127.0.0.1:49524 - R:/127.11.23.254:41819] using SASL/PLAIN
23:49:09.200 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:49:09.202 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 9eb4051c1a4055e19a4fd12d5e8e0fbb.
23:49:09.202 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
23:49:09.203 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
23:49:09.204 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e51dbb
23:49:09.204 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:09.205 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:49:09.205 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
23:49:09.205 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
23:49:09.207 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45f8af29
23:49:09.208 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:09.210 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot dc06bb8446b4d03ecd66cf0d840502e8.
23:49:09.211 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
23:49:09.211 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
23:49:09.212 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3dcf7d48, L:/127.0.0.1:52666 - R:/127.11.23.253:46397] using SASL/PLAIN
23:49:09.212 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id dc06bb8446b4d03ecd66cf0d840502e8.
23:49:09.214 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50d703fe
23:49:09.214 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@c92ab99
23:49:09.214 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:09.214 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:49:09.214 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
23:49:09.215 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:09.215 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
23:49:09.215 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=44), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.254:41819, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.253:46397, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.252:40791, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.23.252:40791: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.23.254:41819: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.23.253:46397: OK, deferred=null) after lookup
23:49:09.217 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:09.218 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
23:49:09.218 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
23:49:09.219 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f04be93
23:49:09.219 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:09.219 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7130890347027730205/checkpoints")
23:49:09.221 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@110bfc69
23:49:09.221 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
23:49:09.221 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (838373697f00655c0fc7c46e22519c43_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
23:49:09.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.217072 11473 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52666:
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:09.224 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@21f067b5
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:09.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:09.224 [DEBUG - pool-118-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: OK, deferred=null) with no deferred attached!
23:49:09.226 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.226771 11473 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:49:09.227 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.228 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.230 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:09.230 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:09.231 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.231 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.231 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.231 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:09.232 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.232 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.232 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.232 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.233 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.233 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.234 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.235 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.235 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.238 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.238 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.238 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.239 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.245 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.245 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.247 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.254 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.261 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.266 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:09.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.268 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.273 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.274 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.274 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.275 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.275 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.275 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.276 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.277 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.277 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.277 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.278 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.278 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.279 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.279 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.280 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.280 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.281 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.282 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.282 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.282 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.283 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.283 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.283 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.283 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.284 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.284 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.284 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.285 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.286 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.287 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.288 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.294 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.294 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.295 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.298 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.299 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.299 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.299 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.307 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.307 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.307 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.308 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.308 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.308 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.309 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.311 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.311 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.311 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.311 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.316603 11460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.23.252:40791, user_credentials={real_user=slave}} blocked reactor thread for 43668.1us
23:49:09.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.323436 11838 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
23:49:09.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.326619 11838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.327 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.327 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.327 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.328 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.328 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.328 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.329 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.323685 11839 tablet_service.cc:1511] Processing CreateTablet for tablet c04afdb8853249d983c25348b5957f29 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
23:49:09.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.328466 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04afdb8853249d983c25348b5957f29. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.328 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.329 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.324254 11837 tablet_service.cc:1511] Processing CreateTablet for tablet e2ed214849c145d89c8bef114ccf3020 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
23:49:09.331 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.332 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.332 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.333 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:09.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.331439 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ed214849c145d89c8bef114ccf3020. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.324472 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 9118d3334da544a9b81ad13815258bb0 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
23:49:09.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.332473 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9118d3334da544a9b81ad13815258bb0. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.324729 11841 tablet_service.cc:1511] Processing CreateTablet for tablet 2c70b27918674dceb963e5732f243626 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
23:49:09.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.333451 11841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c70b27918674dceb963e5732f243626. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.322763 11836 tablet_service.cc:1511] Processing CreateTablet for tablet df4f4ad936b842fc99ba38d6e95bf42f (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
23:49:09.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.337358 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4f4ad936b842fc99ba38d6e95bf42f. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.338212 11703 tablet_service.cc:1511] Processing CreateTablet for tablet 9118d3334da544a9b81ad13815258bb0 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
23:49:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.338402 11702 tablet_service.cc:1511] Processing CreateTablet for tablet c04afdb8853249d983c25348b5957f29 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
23:49:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.339530 11703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9118d3334da544a9b81ad13815258bb0. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.339752 11704 tablet_service.cc:1511] Processing CreateTablet for tablet 2c70b27918674dceb963e5732f243626 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.339803 11701 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.341207 11701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.341651 11700 tablet_service.cc:1511] Processing CreateTablet for tablet e2ed214849c145d89c8bef114ccf3020 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.342100 11700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ed214849c145d89c8bef114ccf3020. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.340606 11699 tablet_service.cc:1511] Processing CreateTablet for tablet df4f4ad936b842fc99ba38d6e95bf42f (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.342971 11702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04afdb8853249d983c25348b5957f29. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.343322 11699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4f4ad936b842fc99ba38d6e95bf42f. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.344 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.358589 11704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c70b27918674dceb963e5732f243626. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.366 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.366 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.367 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.367 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.367 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.367 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.368 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.368 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.368 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.369 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468149369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:09.375 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:09.375 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:09.375 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:09.375 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:09.375 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:09.375 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:09.376 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:09.376 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:09.376 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:09.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:09.376 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:09.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:09.376 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:09.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.383320 11976 tablet_service.cc:1511] Processing CreateTablet for tablet c04afdb8853249d983c25348b5957f29 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
23:49:09.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.384544 11976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04afdb8853249d983c25348b5957f29. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.382912 12804 tablet_bootstrap.cc:492] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6: Bootstrap starting.
23:49:09.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.387307 11975 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
23:49:09.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.387761 11975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.388412 11973 tablet_service.cc:1511] Processing CreateTablet for tablet df4f4ad936b842fc99ba38d6e95bf42f (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
23:49:09.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.388823 11973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4f4ad936b842fc99ba38d6e95bf42f. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.391876 11974 tablet_service.cc:1511] Processing CreateTablet for tablet e2ed214849c145d89c8bef114ccf3020 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
23:49:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.392349 11974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ed214849c145d89c8bef114ccf3020. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.398681 11977 tablet_service.cc:1511] Processing CreateTablet for tablet 9118d3334da544a9b81ad13815258bb0 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
23:49:09.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.399197 11977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9118d3334da544a9b81ad13815258bb0. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.402578 12804 tablet_bootstrap.cc:654] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6: Neither blocks nor log segments found. Creating new log.
23:49:09.403 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=34 ms, finalizationTime=0 ms).
23:49:09.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.404525 12804 log.cc:826] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6: Log is configured to *not* fsync() on all Append() calls
23:49:09.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
23:49:09.406 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.406 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.407 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.407 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.407 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.409 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.382723 11978 tablet_service.cc:1511] Processing CreateTablet for tablet 2c70b27918674dceb963e5732f243626 (DEFAULT_TABLE table=replication_test_table [id=5823fed25c0f4b50b2e2806ffb2181a6]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
23:49:09.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.414016 11978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c70b27918674dceb963e5732f243626. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:09.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.423436 12804 tablet_bootstrap.cc:492] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6: No bootstrap required, opened a new log
23:49:09.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.423827 12804 ts_tablet_manager.cc:1403] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.012s
23:49:09.426 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.427 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.427 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.427 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.427 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.428 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.428 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.429 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.429 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.429 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.435670 12804 raft_consensus.cc:359] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.436167 12804 raft_consensus.cc:385] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.436167 12806 tablet_bootstrap.cc:492] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: Bootstrap starting.
23:49:09.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.436275 12804 raft_consensus.cc:740] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Initialized, Role: FOLLOWER
23:49:09.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.437052 12804 consensus_queue.cc:260] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.440853 12806 tablet_bootstrap.cc:654] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: Neither blocks nor log segments found. Creating new log.
23:49:09.442 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.442764 12806 log.cc:826] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: Log is configured to *not* fsync() on all Append() calls
23:49:09.443 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.445 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.445 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.446 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.446 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.446 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.448 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.448 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.449 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.449 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.449 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.449 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.449 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.450 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.450 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.447 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.452 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.452 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.452 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.452 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.453 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.453 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.453 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.455580 12804 ts_tablet_manager.cc:1434] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.010s
23:49:09.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.456202 12804 tablet_bootstrap.cc:492] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6: Bootstrap starting.
23:49:09.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.458115 12807 tablet_bootstrap.cc:492] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb: Bootstrap starting.
23:49:09.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.458518 12804 tablet_bootstrap.cc:654] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6: Neither blocks nor log segments found. Creating new log.
23:49:09.453 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.459 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.466 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.467 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.467 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.468 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.468 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.468 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.468261 12804 tablet_bootstrap.cc:492] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6: No bootstrap required, opened a new log
23:49:09.468 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.468 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.468468 12804 ts_tablet_manager.cc:1403] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
23:49:09.468 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.468 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.468 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.468952 12806 tablet_bootstrap.cc:492] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: No bootstrap required, opened a new log
23:49:09.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.469300 12806 ts_tablet_manager.cc:1403] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.001s
23:49:09.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.469553 12804 raft_consensus.cc:359] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.469777 12804 raft_consensus.cc:385] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.469864 12804 raft_consensus.cc:740] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Initialized, Role: FOLLOWER
23:49:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.470139 12804 consensus_queue.cc:260] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.470687 12804 ts_tablet_manager.cc:1434] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
23:49:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.471112 12804 tablet_bootstrap.cc:492] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6: Bootstrap starting.
23:49:09.473 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.473 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.473 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.474 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.474 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.474 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.474 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.475 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.475 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.475 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.475 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.475 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.475 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.475517 12807 tablet_bootstrap.cc:654] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb: Neither blocks nor log segments found. Creating new log.
23:49:09.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.476 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.476 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.476 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.476 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.480147 12806 raft_consensus.cc:359] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.480685 12806 raft_consensus.cc:385] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.480744 12807 log.cc:826] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb: Log is configured to *not* fsync() on all Append() calls
23:49:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.480808 12806 raft_consensus.cc:740] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Initialized, Role: FOLLOWER
23:49:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.481630 12804 tablet_bootstrap.cc:654] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6: Neither blocks nor log segments found. Creating new log.
23:49:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.481663 12806 consensus_queue.cc:260] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.483 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.484 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.484 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.484 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.484 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.484 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.484 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.484 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.485 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.485 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.485 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.485 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.487444 12804 tablet_bootstrap.cc:492] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6: No bootstrap required, opened a new log
23:49:09.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.487721 12804 ts_tablet_manager.cc:1403] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.001s
23:49:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.489013 12804 raft_consensus.cc:359] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.489315 12804 raft_consensus.cc:385] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.489403 12804 raft_consensus.cc:740] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Initialized, Role: FOLLOWER
23:49:09.493 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.493 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.493 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.494 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.494 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.494 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.494 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.494 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.494 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.494 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.494 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.494 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.495 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.495 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.495 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.495 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.495 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.496 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.496 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.496 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.496 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.496 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.497 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.497 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.497 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.497 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.497 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.498 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.498 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.498 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.498 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.489800 12804 consensus_queue.cc:260] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.490427 12804 ts_tablet_manager.cc:1434] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:49:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.490784 12804 tablet_bootstrap.cc:492] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6: Bootstrap starting.
23:49:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.495355 12806 ts_tablet_manager.cc:1434] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: Time spent starting tablet: real 0.022s	user 0.013s	sys 0.006s
23:49:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.499277 12806 tablet_bootstrap.cc:492] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39: Bootstrap starting.
23:49:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.501278 12806 tablet_bootstrap.cc:654] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39: Neither blocks nor log segments found. Creating new log.
23:49:09.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.504544 12804 tablet_bootstrap.cc:654] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6: Neither blocks nor log segments found. Creating new log.
23:49:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.507045 12807 tablet_bootstrap.cc:492] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb: No bootstrap required, opened a new log
23:49:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.507422 12807 ts_tablet_manager.cc:1403] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.003s
23:49:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.507638 12806 tablet_bootstrap.cc:492] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39: No bootstrap required, opened a new log
23:49:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.507977 12806 ts_tablet_manager.cc:1403] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39: Time spent bootstrapping tablet: real 0.009s	user 0.003s	sys 0.001s
23:49:09.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.509542 12806 raft_consensus.cc:359] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.509835 12806 raft_consensus.cc:385] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.510051 12806 raft_consensus.cc:740] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Initialized, Role: FOLLOWER
23:49:09.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.510406 12806 consensus_queue.cc:260] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:09.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.511226 12806 ts_tablet_manager.cc:1434] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:49:09.513 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.513 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.514 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.515 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.515 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.515 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.516 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.516 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.516 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.516 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.516 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.517 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.517 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.517 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.518 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.518 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.518 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.518 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.519 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.519 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.516562 12806 tablet_bootstrap.cc:492] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39: Bootstrap starting.
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.517195 12804 tablet_bootstrap.cc:492] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6: No bootstrap required, opened a new log
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.517366 12804 ts_tablet_manager.cc:1403] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6: Time spent bootstrapping tablet: real 0.027s	user 0.000s	sys 0.004s
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.518328 12804 raft_consensus.cc:359] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.518564 12804 raft_consensus.cc:385] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.518672 12804 raft_consensus.cc:740] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Initialized, Role: FOLLOWER
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.518723 12806 tablet_bootstrap.cc:654] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39: Neither blocks nor log segments found. Creating new log.
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.518941 12804 consensus_queue.cc:260] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.519515 12804 ts_tablet_manager.cc:1434] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
23:49:09.522 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.522 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.522 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.523 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.523 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.523 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.523370 12804 tablet_bootstrap.cc:492] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6: Bootstrap starting.
23:49:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.525718 12804 tablet_bootstrap.cc:654] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6: Neither blocks nor log segments found. Creating new log.
23:49:09.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.528414 12807 raft_consensus.cc:359] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.528950 12807 raft_consensus.cc:385] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.529080 12807 raft_consensus.cc:740] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d36357a2ff4787a4d62a32e1d749cb, State: Initialized, Role: FOLLOWER
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.529871 12807 consensus_queue.cc:260] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.530212 12808 raft_consensus.cc:493] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.530479 12808 raft_consensus.cc:515] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.531493 12804 tablet_bootstrap.cc:492] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6: No bootstrap required, opened a new log
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.531689 12804 ts_tablet_manager.cc:1403] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6: Time spent bootstrapping tablet: real 0.008s	user 0.003s	sys 0.001s
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.532510 12804 raft_consensus.cc:359] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.532737 12804 raft_consensus.cc:385] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.532820 12804 raft_consensus.cc:740] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Initialized, Role: FOLLOWER
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.532850 12808 leader_election.cc:290] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.533062 12804 consensus_queue.cc:260] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.535301 12804 ts_tablet_manager.cc:1434] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
23:49:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.535667 12804 tablet_bootstrap.cc:492] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6: Bootstrap starting.
23:49:09.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.537492 12804 tablet_bootstrap.cc:654] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6: Neither blocks nor log segments found. Creating new log.
23:49:09.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.543933 12804 tablet_bootstrap.cc:492] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6: No bootstrap required, opened a new log
23:49:09.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.544796 12818 raft_consensus.cc:493] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.545105 12818 raft_consensus.cc:515] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.545620 12804 ts_tablet_manager.cc:1403] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.000s
23:49:09.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.546777 12804 raft_consensus.cc:359] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.547140 12804 raft_consensus.cc:385] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.547329 12804 raft_consensus.cc:740] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Initialized, Role: FOLLOWER
23:49:09.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.547519 12818 leader_election.cc:290] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.547782 12804 consensus_queue.cc:260] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.551930 12804 ts_tablet_manager.cc:1434] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.002s
23:49:09.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.550990 12599 heartbeater.cc:499] Master 127.11.197.124:40009 was elected leader, sending a full tablet report...
23:49:09.555 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.555 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.555 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.555 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.556 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.556 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.556 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.556 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.557 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.557 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.560 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468149557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:09.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.563839 12046 tablet.cc:2406] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.567523 12808 raft_consensus.cc:493] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.567760 12808 raft_consensus.cc:515] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.568462 12808 leader_election.cc:290] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.574 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.575 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.575 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.576 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.576 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.576 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.576 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.577643 12806 tablet_bootstrap.cc:492] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39: No bootstrap required, opened a new log
23:49:09.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.578011 12806 ts_tablet_manager.cc:1403] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.000s
23:49:09.578 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
23:49:09.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.579664 12806 raft_consensus.cc:359] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.580 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
23:49:09.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.580186 12806 raft_consensus.cc:385] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.580643 12806 raft_consensus.cc:740] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Initialized, Role: FOLLOWER
23:49:09.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.581044 12806 consensus_queue.cc:260] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.581818 12806 ts_tablet_manager.cc:1434] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.002s
23:49:09.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.582350 12806 tablet_bootstrap.cc:492] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39: Bootstrap starting.
23:49:09.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.585884 12806 tablet_bootstrap.cc:654] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39: Neither blocks nor log segments found. Creating new log.
23:49:09.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.590445 12807 ts_tablet_manager.cc:1434] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent starting tablet: real 0.083s	user 0.012s	sys 0.014s
23:49:09.593 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.594 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.594321 12807 tablet_bootstrap.cc:492] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb: Bootstrap starting.
23:49:09.594 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.594 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.594 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.594 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.595 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.595 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.595 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.595 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.595 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.598137 12807 tablet_bootstrap.cc:654] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb: Neither blocks nor log segments found. Creating new log.
23:49:09.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.601737 11997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39" is_pre_election: true
23:49:09.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.603298 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb4f8a4fa7b4419821bdd0e7a3095a1" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39" is_pre_election: true
23:49:09.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.603719 11998 raft_consensus.cc:2468] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 0.
23:49:09.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.604949 11660 leader_election.cc:343] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.605513 11660 leader_election.cc:304] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.606082 12808 raft_consensus.cc:2804] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:09.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.606222 12808 raft_consensus.cc:493] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:09.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.606381 12808 raft_consensus.cc:3060] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.607463 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.608717 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb4f8a4fa7b4419821bdd0e7a3095a1" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.609527 11658 leader_election.cc:343] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.609696 11658 leader_election.cc:304] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6; no voters: 28d36357a2ff4787a4d62a32e1d749cb, 72e4797b3a554897bc93a0a707e1dd39
23:49:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.610589 12808 raft_consensus.cc:515] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.611760 12808 leader_election.cc:290] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Requested vote from peers 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.614 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.614 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.614 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.614 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.614 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.614 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.615 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.615 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.615 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.615 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.615 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.616 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.616 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.616 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.618 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.612056 12808 raft_consensus.cc:2749] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:49:09.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.624600 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb4f8a4fa7b4419821bdd0e7a3095a1" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39"
23:49:09.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.624894 11998 raft_consensus.cc:3060] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.629210 11998 raft_consensus.cc:2468] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 1.
23:49:09.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.630128 11660 leader_election.cc:304] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.630882 12808 raft_consensus.cc:2804] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader election won for term 1
23:49:09.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.631127 12808 raft_consensus.cc:697] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [term 1 LEADER]: Becoming Leader. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Running, Role: LEADER
23:49:09.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.631785 12808 consensus_queue.cc:237] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.640476 11658 leader_election.cc:343] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.641645 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb4f8a4fa7b4419821bdd0e7a3095a1" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:09.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.642470 11658 leader_election.cc:343] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.648028 11473 catalog_manager.cc:5696] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193). New cstate: current_term: 1 leader_uuid: "218317d0341d468eb24bf36793f2d4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } health_report { overall_health: UNKNOWN } } }
23:49:09.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.649469 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ed214849c145d89c8bef114ccf3020" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.649853 11861 raft_consensus.cc:2468] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 0.
23:49:09.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.650966 11932 leader_election.cc:304] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d36357a2ff4787a4d62a32e1d749cb, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.651919 12818 raft_consensus.cc:2804] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:09.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.652098 12818 raft_consensus.cc:493] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:09.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.652215 12818 raft_consensus.cc:3060] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.654 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.654 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.654 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.655 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.655 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.654846 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ed214849c145d89c8bef114ccf3020" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6" is_pre_election: true
23:49:09.655 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.655616 11724 raft_consensus.cc:2468] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 0.
23:49:09.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.656 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.656 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.656 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.656 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.659556 12818 raft_consensus.cc:515] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.660940 12818 leader_election.cc:290] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 election: Requested vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.660954 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ed214849c145d89c8bef114ccf3020" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6"
23:49:09.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.661168 11724 raft_consensus.cc:3060] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.661350 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ed214849c145d89c8bef114ccf3020" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.661581 11861 raft_consensus.cc:3060] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Advancing to term 1
23:49:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.664662 11724 raft_consensus.cc:2468] T e2ed214849c145d89c8bef114ccf3020 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 1.
23:49:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.665030 11861 raft_consensus.cc:2468] T e2ed214849c145d89c8bef114ccf3020 P 28d36357a2ff4787a4d62a32e1d749cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 1.
23:49:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.665529 11932 leader_election.cc:304] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28d36357a2ff4787a4d62a32e1d749cb, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.665899 12818 raft_consensus.cc:2804] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Leader election won for term 1
23:49:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.666031 12808 raft_consensus.cc:493] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.666246 12808 raft_consensus.cc:515] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.667119 12808 leader_election.cc:290] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.667816 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04afdb8853249d983c25348b5957f29" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39" is_pre_election: true
23:49:09.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.668395 11660 leader_election.cc:343] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.669170 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04afdb8853249d983c25348b5957f29" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.669893 11658 leader_election.cc:343] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.670023 11658 leader_election.cc:304] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6; no voters: 28d36357a2ff4787a4d62a32e1d749cb, 72e4797b3a554897bc93a0a707e1dd39
23:49:09.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.670532 12808 raft_consensus.cc:2749] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:49:09.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.672415 12806 tablet_bootstrap.cc:492] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39: No bootstrap required, opened a new log
23:49:09.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.672559 12807 tablet_bootstrap.cc:492] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb: No bootstrap required, opened a new log
23:49:09.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.672585 12806 ts_tablet_manager.cc:1403] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.041s
23:49:09.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.672734 12807 ts_tablet_manager.cc:1403] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.028s
23:49:09.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.673630 12806 raft_consensus.cc:359] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.673782 12807 raft_consensus.cc:359] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.673866 12806 raft_consensus.cc:385] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.674005 12807 raft_consensus.cc:385] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.674026 12806 raft_consensus.cc:740] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Initialized, Role: FOLLOWER
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.674108 12807 raft_consensus.cc:740] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d36357a2ff4787a4d62a32e1d749cb, State: Initialized, Role: FOLLOWER
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.674368 12807 consensus_queue.cc:260] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.674404 12806 consensus_queue.cc:260] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.675905 11772 tablet.cc:2406] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:09.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.679621 12818 raft_consensus.cc:697] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 LEADER]: Becoming Leader. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Running, Role: LEADER
23:49:09.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.679979 12806 ts_tablet_manager.cc:1434] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
23:49:09.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.680464 12806 tablet_bootstrap.cc:492] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39: Bootstrap starting.
23:49:09.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.680464 12818 consensus_queue.cc:237] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.682513 12806 tablet_bootstrap.cc:654] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39: Neither blocks nor log segments found. Creating new log.
23:49:09.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.683966 12807 ts_tablet_manager.cc:1434] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.001s
23:49:09.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.688030 12807 tablet_bootstrap.cc:492] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb: Bootstrap starting.
23:49:09.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.691316 12807 tablet_bootstrap.cc:654] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb: Neither blocks nor log segments found. Creating new log.
23:49:09.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.691797 12806 tablet_bootstrap.cc:492] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39: No bootstrap required, opened a new log
23:49:09.695 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.695 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.695 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.692008 12806 ts_tablet_manager.cc:1403] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
23:49:09.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.693188 12806 raft_consensus.cc:359] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.693512 12806 raft_consensus.cc:385] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.693627 12806 raft_consensus.cc:740] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Initialized, Role: FOLLOWER
23:49:09.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.693943 12806 consensus_queue.cc:260] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.694646 12806 ts_tablet_manager.cc:1434] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
23:49:09.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.695518 12806 tablet_bootstrap.cc:492] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39: Bootstrap starting.
23:49:09.696 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.697 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.697 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.697 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.697 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.697528 12806 tablet_bootstrap.cc:654] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39: Neither blocks nor log segments found. Creating new log.
23:49:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.699640 11473 catalog_manager.cc:5696] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195). New cstate: current_term: 1 leader_uuid: "72e4797b3a554897bc93a0a707e1dd39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } health_report { overall_health: HEALTHY } } }
23:49:09.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.703631 12806 tablet_bootstrap.cc:492] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39: No bootstrap required, opened a new log
23:49:09.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.703949 12806 ts_tablet_manager.cc:1403] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
23:49:09.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.705160 12806 raft_consensus.cc:359] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.705535 12806 raft_consensus.cc:385] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.705716 12806 raft_consensus.cc:740] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Initialized, Role: FOLLOWER
23:49:09.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.706056 12806 consensus_queue.cc:260] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.707226 12806 ts_tablet_manager.cc:1434] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
23:49:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.714982 12818 raft_consensus.cc:493] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.715194 12818 raft_consensus.cc:515] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.715997 12818 leader_election.cc:290] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.716583 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04afdb8853249d983c25348b5957f29" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.716650 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04afdb8853249d983c25348b5957f29" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6" is_pre_election: true
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.716898 11724 raft_consensus.cc:2468] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 0.
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.717005 12807 tablet_bootstrap.cc:492] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb: No bootstrap required, opened a new log
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.717272 12807 ts_tablet_manager.cc:1403] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.004s
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.717342 11932 leader_election.cc:343] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415): Illegal state: must be running to vote when last-logged opid is not known
23:49:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.717581 11932 leader_election.cc:304] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 28d36357a2ff4787a4d62a32e1d749cb
23:49:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718143 12807 raft_consensus.cc:359] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718357 12807 raft_consensus.cc:385] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718360 12818 raft_consensus.cc:2804] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718436 12807 raft_consensus.cc:740] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d36357a2ff4787a4d62a32e1d749cb, State: Initialized, Role: FOLLOWER
23:49:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718444 12818 raft_consensus.cc:493] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:09.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718559 12818 raft_consensus.cc:3060] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.718765 12807 consensus_queue.cc:260] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.719566 12807 ts_tablet_manager.cc:1434] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.719920 12807 tablet_bootstrap.cc:492] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb: Bootstrap starting.
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.721410 12818 raft_consensus.cc:515] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.721886 12807 tablet_bootstrap.cc:654] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb: Neither blocks nor log segments found. Creating new log.
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.722564 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04afdb8853249d983c25348b5957f29" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6"
23:49:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.722864 11724 raft_consensus.cc:3060] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.726900 11724 raft_consensus.cc:2468] T c04afdb8853249d983c25348b5957f29 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 1.
23:49:09.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.727550 11932 leader_election.cc:304] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.727906 12837 raft_consensus.cc:2804] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Leader election won for term 1
23:49:09.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.728118 12837 raft_consensus.cc:697] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 LEADER]: Becoming Leader. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Running, Role: LEADER
23:49:09.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.728457 12837 consensus_queue.cc:237] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.728989 12818 leader_election.cc:290] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 election: Requested vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.729614 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04afdb8853249d983c25348b5957f29" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:09.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.729889 11861 raft_consensus.cc:3060] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Advancing to term 1
23:49:09.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.732812 11861 raft_consensus.cc:2468] T c04afdb8853249d983c25348b5957f29 P 28d36357a2ff4787a4d62a32e1d749cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 1.
23:49:09.734 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.734 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.734 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.735 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.735 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.736 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.736681 12807 tablet_bootstrap.cc:492] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb: No bootstrap required, opened a new log
23:49:09.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.736896 12807 ts_tablet_manager.cc:1403] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.003s
23:49:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.737782 12807 raft_consensus.cc:359] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.737970 12807 raft_consensus.cc:385] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.738066 12807 raft_consensus.cc:740] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d36357a2ff4787a4d62a32e1d749cb, State: Initialized, Role: FOLLOWER
23:49:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.738335 12807 consensus_queue.cc:260] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.738937 12807 ts_tablet_manager.cc:1434] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
23:49:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.740482 12807 tablet_bootstrap.cc:492] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb: Bootstrap starting.
23:49:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.742543 12807 tablet_bootstrap.cc:654] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb: Neither blocks nor log segments found. Creating new log.
23:49:09.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:09.745252 11909 tablet.cc:2406] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:09.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.747555 11472 catalog_manager.cc:5696] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195). New cstate: current_term: 1 leader_uuid: "72e4797b3a554897bc93a0a707e1dd39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } health_report { overall_health: HEALTHY } } }
23:49:09.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.752969 12807 tablet_bootstrap.cc:492] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb: No bootstrap required, opened a new log
23:49:09.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.753188 12807 ts_tablet_manager.cc:1403] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.005s
23:49:09.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.754232 12807 raft_consensus.cc:359] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.754503 12807 raft_consensus.cc:385] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.754607 12807 raft_consensus.cc:740] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d36357a2ff4787a4d62a32e1d749cb, State: Initialized, Role: FOLLOWER
23:49:09.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.754982 12807 consensus_queue.cc:260] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.755726 12807 ts_tablet_manager.cc:1434] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:49:09.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.756114 12807 tablet_bootstrap.cc:492] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb: Bootstrap starting.
23:49:09.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.757961 12807 tablet_bootstrap.cc:654] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb: Neither blocks nor log segments found. Creating new log.
23:49:09.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.763393 12825 raft_consensus.cc:493] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.763598 12825 raft_consensus.cc:515] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.765785 12825 leader_election.cc:290] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.767609 12837 raft_consensus.cc:493] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.767828 12837 raft_consensus.cc:515] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.768765 12837 leader_election.cc:290] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.769496 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6" is_pre_election: true
23:49:09.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.769670 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.769763 11724 raft_consensus.cc:2468] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 0.
23:49:09.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.769932 11861 raft_consensus.cc:2468] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 0.
23:49:09.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.770437 11932 leader_election.cc:304] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.770853 12837 raft_consensus.cc:2804] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:09.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.770987 12837 raft_consensus.cc:493] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:09.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.771104 12837 raft_consensus.cc:3060] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.775369 12837 raft_consensus.cc:515] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.776458 12837 leader_election.cc:290] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 election: Requested vote from peers 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.777146 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:09.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.777172 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "72e4797b3a554897bc93a0a707e1dd39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6"
23:49:09.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.777393 11861 raft_consensus.cc:3060] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Advancing to term 1
23:49:09.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.777413 11724 raft_consensus.cc:3060] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.781286 11724 raft_consensus.cc:2468] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 1.
23:49:09.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.782764 11861 raft_consensus.cc:2468] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e4797b3a554897bc93a0a707e1dd39 in term 1.
23:49:09.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.781814 11932 leader_election.cc:304] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.783708 12837 raft_consensus.cc:2804] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Leader election won for term 1
23:49:09.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.784511 12837 raft_consensus.cc:697] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 LEADER]: Becoming Leader. State: Replica: 72e4797b3a554897bc93a0a707e1dd39, State: Running, Role: LEADER
23:49:09.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.785000 12837 consensus_queue.cc:237] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.787614 11724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "28d36357a2ff4787a4d62a32e1d749cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218317d0341d468eb24bf36793f2d4a6" is_pre_election: true
23:49:09.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.787930 12807 tablet_bootstrap.cc:492] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb: No bootstrap required, opened a new log
23:49:09.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.788113 12807 ts_tablet_manager.cc:1403] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
23:49:09.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.788230 11724 raft_consensus.cc:2393] T 9118d3334da544a9b81ad13815258bb0 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28d36357a2ff4787a4d62a32e1d749cb in current term 1: Already voted for candidate 72e4797b3a554897bc93a0a707e1dd39 in this term.
23:49:09.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.789016 12807 raft_consensus.cc:359] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.789220 12807 raft_consensus.cc:385] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:09.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.789330 12807 raft_consensus.cc:740] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28d36357a2ff4787a4d62a32e1d749cb, State: Initialized, Role: FOLLOWER
23:49:09.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.789651 12807 consensus_queue.cc:260] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.793184 12807 ts_tablet_manager.cc:1434] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.001s
23:49:09.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.799436 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9118d3334da544a9b81ad13815258bb0" candidate_uuid: "28d36357a2ff4787a4d62a32e1d749cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39" is_pre_election: true
23:49:09.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.801137 11472 catalog_manager.cc:5696] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195). New cstate: current_term: 1 leader_uuid: "72e4797b3a554897bc93a0a707e1dd39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } health_report { overall_health: HEALTHY } } }
23:49:09.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.804306 11797 leader_election.cc:304] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28d36357a2ff4787a4d62a32e1d749cb; no voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39
23:49:09.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.804997 12825 raft_consensus.cc:2749] T 9118d3334da544a9b81ad13815258bb0 P 28d36357a2ff4787a4d62a32e1d749cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:49:09.826 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.826 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.827 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.827 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.827 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.827 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.827 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.827 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.827 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.827 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.827 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.827 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.865072 12808 raft_consensus.cc:493] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.865365 12808 raft_consensus.cc:515] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.866348 12808 leader_election.cc:290] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.867028 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70b27918674dceb963e5732f243626" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39" is_pre_election: true
23:49:09.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.867174 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70b27918674dceb963e5732f243626" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.867308 11998 raft_consensus.cc:2468] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 0.
23:49:09.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.867496 11861 raft_consensus.cc:2468] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 0.
23:49:09.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.867827 11660 leader_election.cc:304] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.868319 12808 raft_consensus.cc:2804] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:09.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.868445 12808 raft_consensus.cc:493] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:09.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.868564 12808 raft_consensus.cc:3060] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468149869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:09.874 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.875 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.875 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.875 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.876 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.876 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.872707 12808 raft_consensus.cc:515] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.875332 12808 leader_election.cc:290] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Requested vote from peers 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301), 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415)
23:49:09.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.877097 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70b27918674dceb963e5732f243626" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:09.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.877097 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c70b27918674dceb963e5732f243626" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39"
23:49:09.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.877374 11998 raft_consensus.cc:3060] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.877339 11861 raft_consensus.cc:3060] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Advancing to term 1
23:49:09.879 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:09.880 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
23:49:09.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.880848 11998 raft_consensus.cc:2468] T 2c70b27918674dceb963e5732f243626 P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 1.
23:49:09.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.881104 11861 raft_consensus.cc:2468] T 2c70b27918674dceb963e5732f243626 P 28d36357a2ff4787a4d62a32e1d749cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 1.
23:49:09.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.881541 11660 leader_election.cc:304] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.881914 12808 raft_consensus.cc:2804] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader election won for term 1
23:49:09.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.882084 12808 raft_consensus.cc:697] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [term 1 LEADER]: Becoming Leader. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Running, Role: LEADER
23:49:09.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.882403 12808 consensus_queue.cc:237] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } }
23:49:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.887836 12834 raft_consensus.cc:493] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.888208 12834 raft_consensus.cc:515] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.889360 12834 leader_election.cc:290] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.890121 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4f4ad936b842fc99ba38d6e95bf42f" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb" is_pre_election: true
23:49:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.890364 11861 raft_consensus.cc:2468] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 0.
23:49:09.894 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:09.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.890908 11658 leader_election.cc:304] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 28d36357a2ff4787a4d62a32e1d749cb; no voters: 
23:49:09.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.891144 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4f4ad936b842fc99ba38d6e95bf42f" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39" is_pre_election: true
23:49:09.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.891371 11998 raft_consensus.cc:2468] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 0.
23:49:09.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.891438 12834 raft_consensus.cc:2804] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:09.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.891549 12834 raft_consensus.cc:493] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:09.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.891652 12834 raft_consensus.cc:3060] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.895 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:09.895 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:09.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:09.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:09.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.896023 12834 raft_consensus.cc:515] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:09.896 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:09.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.897869 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4f4ad936b842fc99ba38d6e95bf42f" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28d36357a2ff4787a4d62a32e1d749cb"
23:49:09.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.898015 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4f4ad936b842fc99ba38d6e95bf42f" candidate_uuid: "218317d0341d468eb24bf36793f2d4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72e4797b3a554897bc93a0a707e1dd39"
23:49:09.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.898115 11861 raft_consensus.cc:3060] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Advancing to term 1
23:49:09.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.898258 11998 raft_consensus.cc:3060] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [term 0 FOLLOWER]: Advancing to term 1
23:49:09.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.899621 12834 leader_election.cc:290] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Requested vote from peers 28d36357a2ff4787a4d62a32e1d749cb (127.11.23.194:36415), 72e4797b3a554897bc93a0a707e1dd39 (127.11.23.195:43301)
23:49:09.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.900955 11998 raft_consensus.cc:2468] T df4f4ad936b842fc99ba38d6e95bf42f P 72e4797b3a554897bc93a0a707e1dd39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 1.
23:49:09.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.901655 11660 leader_election.cc:304] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218317d0341d468eb24bf36793f2d4a6, 72e4797b3a554897bc93a0a707e1dd39; no voters: 
23:49:09.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.902016 12834 raft_consensus.cc:2804] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 1 FOLLOWER]: Leader election won for term 1
23:49:09.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.902783 11861 raft_consensus.cc:2468] T df4f4ad936b842fc99ba38d6e95bf42f P 28d36357a2ff4787a4d62a32e1d749cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218317d0341d468eb24bf36793f2d4a6 in term 1.
23:49:09.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.903084 12834 raft_consensus.cc:697] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [term 1 LEADER]: Becoming Leader. State: Replica: 218317d0341d468eb24bf36793f2d4a6, State: Running, Role: LEADER
23:49:09.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.903584 12834 consensus_queue.cc:237] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } }
23:49:09.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.907367 11472 catalog_manager.cc:5696] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193). New cstate: current_term: 1 leader_uuid: "218317d0341d468eb24bf36793f2d4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } health_report { overall_health: UNKNOWN } } }
23:49:09.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:09.918227 11472 catalog_manager.cc:5696] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193). New cstate: current_term: 1 leader_uuid: "218317d0341d468eb24bf36793f2d4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 } health_report { overall_health: UNKNOWN } } }
23:49:10.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:10.034 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:10.035 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:10.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.035 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:10.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.035 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.036 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.036 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.036 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.036 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:10.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468150057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:10.066 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:10.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.066481 12837 consensus_queue.cc:1048] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
23:49:10.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.067631 11861 raft_consensus.cc:3060] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 28d36357a2ff4787a4d62a32e1d749cb [term 0 FOLLOWER]: Advancing to term 1
23:49:10.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.072813 12834 consensus_queue.cc:1048] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.073 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:10.074 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:10.074 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:10.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.075 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:10.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.088559 12849 consensus_queue.cc:1048] T 2fb4f8a4fa7b4419821bdd0e7a3095a1 P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.106282 12818 consensus_queue.cc:1048] T e2ed214849c145d89c8bef114ccf3020 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.150465 12738 heartbeater.cc:499] Master 127.11.197.124:40009 was elected leader, sending a full tablet report...
23:49:10.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.165887 12836 consensus_queue.cc:1048] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.174953 12818 consensus_queue.cc:1048] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:10.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.237102 12836 consensus_queue.cc:1048] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.240 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:10.240 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:10.240 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:10.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:10.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:10.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:10.241 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:10.241 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:10.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:10.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:10.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:10.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:10.242 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:10.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.246722 12837 consensus_queue.cc:1048] T c04afdb8853249d983c25348b5957f29 P 72e4797b3a554897bc93a0a707e1dd39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218317d0341d468eb24bf36793f2d4a6" member_type: VOTER last_known_addr { host: "127.11.23.193" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.274 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:10.274 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:10.274 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:10.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.275 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.275 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:10.299 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:10.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:10.300 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:10.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:10.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:10.300 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:10.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:10.300 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:10.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:10.300 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:10.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:10.300 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:10.301 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:10.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.326740 12808 consensus_queue.cc:1048] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:10.334 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:10.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.334018 12834 consensus_queue.cc:1048] T df4f4ad936b842fc99ba38d6e95bf42f P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.335 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:10.335 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:10.335 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.335 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.335 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.335 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.336 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:10.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468150369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:10.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.376962 12808 consensus_queue.cc:1048] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72e4797b3a554897bc93a0a707e1dd39" member_type: VOTER last_known_addr { host: "127.11.23.195" port: 43301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.379 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:10.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
23:49:10.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.384609 12834 consensus_queue.cc:1048] T 2c70b27918674dceb963e5732f243626 P 218317d0341d468eb24bf36793f2d4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28d36357a2ff4787a4d62a32e1d749cb" member_type: VOTER last_known_addr { host: "127.11.23.194" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:10.395 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:10.396 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:10.396 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:10.396 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:10.396 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:10.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:10.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:10.396 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:10.397 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:10.397 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:10.397 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:10.397 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:10.397 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:10.493 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:10.493 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:10.494 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:10.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.494 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.494 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.494 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.494 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:10.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:10.548 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:10.548 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:10.548 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:10.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:10.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:10.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:10.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:10.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:10.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:10.549 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:10.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:10.549 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:10.549 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:10.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468150557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:10.565 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:10.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
23:49:10.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:10.621 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:10.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:10.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:10.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:10.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:10.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:10.622 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:10.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.23.253:46397, [3ms] Sub RPC GetTableLocations: received response from server master-127.11.23.253:46397: OK, deferred=null) after lookup
23:49:10.623 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)] connecting to peer
23:49:10.624 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)] Successfully connected to peer
23:49:10.634 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.637 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfce65f1c, L:/127.0.0.1:46566 - R:/127.11.23.193:42471] using TOKEN/null
23:49:10.684 [DEBUG - main] (Connection.java:748) [peer 72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)] connecting to peer
23:49:10.685 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)] Successfully connected to peer
23:49:10.708 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.711 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xb5000beb, L:/127.0.0.1:57580 - R:/127.11.23.195:43301] using TOKEN/null
23:49:10.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:10.781 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:10.783 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:10.784 [DEBUG - main] (Connection.java:748) [peer master-127.11.197.125:42079(127.11.197.125:42079)] connecting to peer
23:49:10.785 [DEBUG - main] (Connection.java:748) [peer master-127.11.197.124:40009(127.11.197.124:40009)] connecting to peer
23:49:10.786 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.197.125:42079(127.11.197.125:42079)] Successfully connected to peer
23:49:10.791 [DEBUG - main] (Connection.java:748) [peer master-127.11.197.126:39201(127.11.197.126:39201)] connecting to peer
23:49:10.791 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.197.124:40009(127.11.197.124:40009)] Successfully connected to peer
23:49:10.803 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.124
23:49:10.807 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.197.126:39201(127.11.197.126:39201)] Successfully connected to peer
23:49:10.811 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.126
23:49:10.813 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.814 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.125
23:49:10.816 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0ee4b913, L:/127.0.0.1:34230 - R:/127.11.197.124:40009] using SASL/PLAIN
23:49:10.819 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:10.819 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=35), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.125:42079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.124:40009, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.126:39201, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.124:40009: OK, deferred=null) after lookup
23:49:10.822 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.825 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0c0545a4, L:/127.0.0.1:43826 - R:/127.11.197.125:42079] using SASL/PLAIN
23:49:10.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:10.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:10.828 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:10.828 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.828 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.828 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.828 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:10.829 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:10.829 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:10.829 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:10.829 [DEBUG - main] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:10.831 [DEBUG - main] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:10.831 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6d283f71, L:/127.0.0.1:46062 - R:/127.11.197.126:39201] using SASL/PLAIN
23:49:10.831 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.23.254:41819(127.11.23.254:41819)] Successfully connected to peer
23:49:10.833 [DEBUG - main] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:10.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:10.834 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.23.253:46397(127.11.23.253:46397)] Successfully connected to peer
23:49:10.836 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.253
23:49:10.843 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.23.252:40791(127.11.23.252:40791)] Successfully connected to peer
23:49:10.844 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.254
23:49:10.845 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.849 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x105f6192, L:/127.0.0.1:46144 - R:/127.11.23.253:46397] using SASL/PLAIN
23:49:10.851 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:10.851 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=29), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.254:41819, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.253:46397, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.252:40791, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.23.253:46397: OK, deferred=null) after lookup
23:49:10.853 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:10.856 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:10.856 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:10.857 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:10.857 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:10.857 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:10.857 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:10.857 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.860054 12237 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34230:
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:49:10.860 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.252
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
23:49:10.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:10.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:10.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:49:10.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:10.863332 12237 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:49:10.869 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.869 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:10.869 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468150869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:10.872 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xce2597e5, L:/127.0.0.1:53242 - R:/127.11.23.252:40791] using SASL/PLAIN
23:49:10.875 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0d51c745, L:/127.0.0.1:47012 - R:/127.11.23.254:41819] using SASL/PLAIN
23:49:10.880 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:10.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
23:49:10.927 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:10.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.981070 12532 tablet_service.cc:1511] Processing CreateTablet for tablet e50a492114a341ae82a87a26089c51d9 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
23:49:10.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.981514 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 474a770d457940f5adfafd47bc5383d4 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
23:49:10.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.982324 12532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e50a492114a341ae82a87a26089c51d9. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:10.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.982515 12530 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc9cb02be0642fbb3d250accc6d86e6 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
23:49:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.982329 12531 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9bb7d6b54741d5aeebb76088d422fb (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
23:49:10.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.983345 12533 tablet_service.cc:1511] Processing CreateTablet for tablet eb8fa8ace3754818987b888f909a9f95 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
23:49:10.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.990201 12529 tablet_service.cc:1511] Processing CreateTablet for tablet 9861564b964044d29589d20627bcaf84 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
23:49:10.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.995462 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9bb7d6b54741d5aeebb76088d422fb. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:10.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.996129 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8fa8ace3754818987b888f909a9f95. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:10.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.996446 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 474a770d457940f5adfafd47bc5383d4. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:10.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.997433 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc9cb02be0642fbb3d250accc6d86e6. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:10.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:10.999657 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9861564b964044d29589d20627bcaf84. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.010 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:11.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.018699 12394 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9bb7d6b54741d5aeebb76088d422fb (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
23:49:11.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.019132 12392 tablet_service.cc:1511] Processing CreateTablet for tablet 9861564b964044d29589d20627bcaf84 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
23:49:11.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.019874 12392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9861564b964044d29589d20627bcaf84. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.019945 12391 tablet_service.cc:1511] Processing CreateTablet for tablet 474a770d457940f5adfafd47bc5383d4 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
23:49:11.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.020440 12393 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc9cb02be0642fbb3d250accc6d86e6 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
23:49:11.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.020449 12394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9bb7d6b54741d5aeebb76088d422fb. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.020717 12395 tablet_service.cc:1511] Processing CreateTablet for tablet e50a492114a341ae82a87a26089c51d9 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
23:49:11.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.021201 12395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e50a492114a341ae82a87a26089c51d9. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.018487 12396 tablet_service.cc:1511] Processing CreateTablet for tablet eb8fa8ace3754818987b888f909a9f95 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
23:49:11.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.021940 12396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8fa8ace3754818987b888f909a9f95. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.023823 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 474a770d457940f5adfafd47bc5383d4. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.024787 12393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc9cb02be0642fbb3d250accc6d86e6. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.041818 12909 tablet_bootstrap.cc:492] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: Bootstrap starting.
23:49:11.048 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:11.048 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:11.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.048911 12909 tablet_bootstrap.cc:654] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: Neither blocks nor log segments found. Creating new log.
23:49:11.049 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:11.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:11.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:11.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:11.050 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:11.050 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:11.050 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:11.050 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:11.050 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:11.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.050609 12909 log.cc:826] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: Log is configured to *not* fsync() on all Append() calls
23:49:11.050 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:11.050 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:11.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.052143 12910 tablet_bootstrap.cc:492] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: Bootstrap starting.
23:49:11.052 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:11.052 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:11.052 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:11.052 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:11.052 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:11.053 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:11.053 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:11.053 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:11.053 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:11.053 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:11.053 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:11.053 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:11.053 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:11.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468151057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:11.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.057988 12910 tablet_bootstrap.cc:654] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: Neither blocks nor log segments found. Creating new log.
23:49:11.069 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:11.070 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
23:49:11.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.070046 12671 tablet_service.cc:1511] Processing CreateTablet for tablet e50a492114a341ae82a87a26089c51d9 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
23:49:11.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.071071 12672 tablet_service.cc:1511] Processing CreateTablet for tablet eb8fa8ace3754818987b888f909a9f95 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
23:49:11.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.071988 12672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8fa8ace3754818987b888f909a9f95. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.073411 12910 log.cc:826] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: Log is configured to *not* fsync() on all Append() calls
23:49:11.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.075158 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e50a492114a341ae82a87a26089c51d9. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.076152 12909 tablet_bootstrap.cc:492] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: No bootstrap required, opened a new log
23:49:11.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.076648 12909 ts_tablet_manager.cc:1403] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.006s
23:49:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.085062 12910 tablet_bootstrap.cc:492] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: No bootstrap required, opened a new log
23:49:11.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.085606 12910 ts_tablet_manager.cc:1403] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
23:49:11.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.086031 12909 raft_consensus.cc:359] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.086505 12909 raft_consensus.cc:385] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.086643 12909 raft_consensus.cc:740] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Initialized, Role: FOLLOWER
23:49:11.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.087607 12909 consensus_queue.cc:260] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.090977 12669 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc9cb02be0642fbb3d250accc6d86e6 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
23:49:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.091462 12668 tablet_service.cc:1511] Processing CreateTablet for tablet 9861564b964044d29589d20627bcaf84 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
23:49:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.091574 12667 tablet_service.cc:1511] Processing CreateTablet for tablet 474a770d457940f5adfafd47bc5383d4 (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
23:49:11.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.091562 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc9cb02be0642fbb3d250accc6d86e6. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.092243 12670 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9bb7d6b54741d5aeebb76088d422fb (DEFAULT_TABLE table=replication_test_table [id=3c0ec8d82383476fbf1d402187840860]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
23:49:11.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.092691 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9bb7d6b54741d5aeebb76088d422fb. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.095091 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9861564b964044d29589d20627bcaf84. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.095384 12667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 474a770d457940f5adfafd47bc5383d4. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.097623 12910 raft_consensus.cc:359] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.098121 12910 raft_consensus.cc:385] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.098230 12910 raft_consensus.cc:740] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Initialized, Role: FOLLOWER
23:49:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.099231 12910 consensus_queue.cc:260] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.103822 12914 tablet_bootstrap.cc:492] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165: Bootstrap starting.
23:49:11.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.123824 12909 ts_tablet_manager.cc:1434] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.005s
23:49:11.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.125974 12914 tablet_bootstrap.cc:654] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165: Neither blocks nor log segments found. Creating new log.
23:49:11.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.129204 12914 log.cc:826] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165: Log is configured to *not* fsync() on all Append() calls
23:49:11.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.129385 12910 ts_tablet_manager.cc:1434] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: Time spent starting tablet: real 0.043s	user 0.014s	sys 0.013s
23:49:11.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.131098 12910 tablet_bootstrap.cc:492] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175: Bootstrap starting.
23:49:11.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.135171 12910 tablet_bootstrap.cc:654] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175: Neither blocks nor log segments found. Creating new log.
23:49:11.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.142379 12909 tablet_bootstrap.cc:492] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11: Bootstrap starting.
23:49:11.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.144351 12910 tablet_bootstrap.cc:492] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175: No bootstrap required, opened a new log
23:49:11.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.144574 12910 ts_tablet_manager.cc:1403] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.001s
23:49:11.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.145865 12910 raft_consensus.cc:359] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.146114 12910 raft_consensus.cc:385] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.146214 12910 raft_consensus.cc:740] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Initialized, Role: FOLLOWER
23:49:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.146493 12910 consensus_queue.cc:260] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.147298 12910 ts_tablet_manager.cc:1434] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
23:49:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.147646 12910 tablet_bootstrap.cc:492] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175: Bootstrap starting.
23:49:11.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.150278 12910 tablet_bootstrap.cc:654] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175: Neither blocks nor log segments found. Creating new log.
23:49:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.150938 12914 tablet_bootstrap.cc:492] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165: No bootstrap required, opened a new log
23:49:11.155 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:11.155 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:11.155 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:11.156 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:11.156 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:11.156 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:11.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:11.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:11.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:11.157 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:11.157 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:11.158 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:11.158 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:11.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.151295 12914 ts_tablet_manager.cc:1403] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.003s
23:49:11.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.163164 12915 raft_consensus.cc:493] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.163501 12915 raft_consensus.cc:515] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.165490 12914 raft_consensus.cc:359] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.165998 12915 leader_election.cc:290] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.172364 12914 raft_consensus.cc:385] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.172595 12914 raft_consensus.cc:740] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7878f56361a947c08732561c97ca3165, State: Initialized, Role: FOLLOWER
23:49:11.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.174276 12914 consensus_queue.cc:260] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.177219 12909 tablet_bootstrap.cc:654] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11: Neither blocks nor log segments found. Creating new log.
23:49:11.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.185060 12909 tablet_bootstrap.cc:492] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11: No bootstrap required, opened a new log
23:49:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.187666 12909 ts_tablet_manager.cc:1403] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent bootstrapping tablet: real 0.046s	user 0.002s	sys 0.003s
23:49:11.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.189107 12909 raft_consensus.cc:359] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.193485 12464 tablet.cc:2406] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:11.195 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:11.196 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:11.196 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:11.196 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:11.196 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:11.196 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:11.197 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:11.197 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:11.197 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:11.198 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:11.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:11.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:11.198 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:11.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.195820 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474a770d457940f5adfafd47bc5383d4" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165" is_pre_election: true
23:49:11.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.199188 12352 leader_election.cc:343] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441): Illegal state: must be running to vote when last-logged opid is not known
23:49:11.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.199777 12909 raft_consensus.cc:385] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.200039 12909 raft_consensus.cc:740] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Initialized, Role: FOLLOWER
23:49:11.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.200609 12909 consensus_queue.cc:260] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.204494 12914 ts_tablet_manager.cc:1434] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.007s
23:49:11.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.210280 12909 ts_tablet_manager.cc:1434] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.002s
23:49:11.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.215106 12914 tablet_bootstrap.cc:492] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165: Bootstrap starting.
23:49:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.217523 12914 tablet_bootstrap.cc:654] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165: Neither blocks nor log segments found. Creating new log.
23:49:11.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.220911 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474a770d457940f5adfafd47bc5383d4" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" is_pre_election: true
23:49:11.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.221443 12553 raft_consensus.cc:2468] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94098e6939f4bbba635e95d3dd8f175 in term 0.
23:49:11.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:11.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.223899 12909 tablet_bootstrap.cc:492] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11: Bootstrap starting.
23:49:11.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.223722 12351 leader_election.cc:304] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11, b94098e6939f4bbba635e95d3dd8f175; no voters: 7878f56361a947c08732561c97ca3165
23:49:11.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.224324 12915 raft_consensus.cc:2804] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:11.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.224532 12915 raft_consensus.cc:493] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:11.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.224645 12915 raft_consensus.cc:3060] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.218418 12921 raft_consensus.cc:493] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.225733 12921 raft_consensus.cc:515] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.228 [DEBUG - pool-118-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30023), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [4ms] received response from server master-127.7.104.126:33577: OK, deferred=null) with no deferred attached!
23:49:11.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.227854 12915 raft_consensus.cc:515] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.230177 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474a770d457940f5adfafd47bc5383d4" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165"
23:49:11.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.230435 12915 leader_election.cc:290] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 election: Requested vote from peers 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.230827 12352 leader_election.cc:343] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441): Illegal state: must be running to vote when last-logged opid is not known
23:49:11.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.236698 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474a770d457940f5adfafd47bc5383d4" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:11.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.236939 12553 raft_consensus.cc:3060] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.242209 12914 tablet_bootstrap.cc:492] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165: No bootstrap required, opened a new log
23:49:11.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.242870 12553 raft_consensus.cc:2468] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94098e6939f4bbba635e95d3dd8f175 in term 1.
23:49:11.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.242769 12914 ts_tablet_manager.cc:1403] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.000s
23:49:11.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.243834 12351 leader_election.cc:304] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11, b94098e6939f4bbba635e95d3dd8f175; no voters: 7878f56361a947c08732561c97ca3165
23:49:11.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.244421 12915 raft_consensus.cc:2804] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader election won for term 1
23:49:11.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.244590 12914 raft_consensus.cc:359] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.244829 12914 raft_consensus.cc:385] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.244942 12914 raft_consensus.cc:740] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7878f56361a947c08732561c97ca3165, State: Initialized, Role: FOLLOWER
23:49:11.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.245044 12915 raft_consensus.cc:697] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [term 1 LEADER]: Becoming Leader. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Running, Role: LEADER
23:49:11.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.245632 12915 consensus_queue.cc:237] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.247685 12914 consensus_queue.cc:260] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.248435 12914 ts_tablet_manager.cc:1434] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
23:49:11.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.248808 12914 tablet_bootstrap.cc:492] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165: Bootstrap starting.
23:49:11.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.255105 12914 tablet_bootstrap.cc:654] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165: Neither blocks nor log segments found. Creating new log.
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.257339 12910 tablet_bootstrap.cc:492] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175: No bootstrap required, opened a new log
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.257602 12910 ts_tablet_manager.cc:1403] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.043s
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.258553 12910 raft_consensus.cc:359] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.258867 12910 raft_consensus.cc:385] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.258960 12910 raft_consensus.cc:740] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Initialized, Role: FOLLOWER
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.259212 12910 consensus_queue.cc:260] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.259888 12910 ts_tablet_manager.cc:1434] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.260246 12910 tablet_bootstrap.cc:492] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175: Bootstrap starting.
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.262128 12910 tablet_bootstrap.cc:654] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175: Neither blocks nor log segments found. Creating new log.
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.262583 12236 catalog_manager.cc:5696] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 reported cstate change: term changed from 0 to 1, leader changed from <none> to b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65). New cstate: current_term: 1 leader_uuid: "b94098e6939f4bbba635e95d3dd8f175" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } health_report { overall_health: UNKNOWN } } }
23:49:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.264235 12602 tablet.cc:2406] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.272697 12910 tablet_bootstrap.cc:492] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175: No bootstrap required, opened a new log
23:49:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.272919 12910 ts_tablet_manager.cc:1403] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.009s
23:49:11.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.274485 12910 raft_consensus.cc:359] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.275558 12910 raft_consensus.cc:385] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.275673 12910 raft_consensus.cc:740] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Initialized, Role: FOLLOWER
23:49:11.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.275920 12910 consensus_queue.cc:260] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.276587 12910 ts_tablet_manager.cc:1434] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
23:49:11.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.276938 12910 tablet_bootstrap.cc:492] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175: Bootstrap starting.
23:49:11.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.277396 12921 leader_election.cc:290] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:11.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.277833 12909 tablet_bootstrap.cc:654] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11: Neither blocks nor log segments found. Creating new log.
23:49:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.279182 12910 tablet_bootstrap.cc:654] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175: Neither blocks nor log segments found. Creating new log.
23:49:11.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.288066 12910 tablet_bootstrap.cc:492] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175: No bootstrap required, opened a new log
23:49:11.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.288349 12910 ts_tablet_manager.cc:1403] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.005s
23:49:11.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.289467 12910 raft_consensus.cc:359] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.289844 12910 raft_consensus.cc:385] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.289932 12910 raft_consensus.cc:740] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Initialized, Role: FOLLOWER
23:49:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.290210 12910 consensus_queue.cc:260] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.291039 12910 ts_tablet_manager.cc:1434] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
23:49:11.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.291468 12910 tablet_bootstrap.cc:492] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175: Bootstrap starting.
23:49:11.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.293685 12910 tablet_bootstrap.cc:654] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175: Neither blocks nor log segments found. Creating new log.
23:49:11.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.303110 12910 tablet_bootstrap.cc:492] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175: No bootstrap required, opened a new log
23:49:11.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.303341 12910 ts_tablet_manager.cc:1403] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
23:49:11.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.304500 12910 raft_consensus.cc:359] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.304816 12910 raft_consensus.cc:385] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.304917 12910 raft_consensus.cc:740] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Initialized, Role: FOLLOWER
23:49:11.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.305193 12910 consensus_queue.cc:260] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.305891 12910 ts_tablet_manager.cc:1434] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:49:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.310225 12921 raft_consensus.cc:493] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.310212 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50a492114a341ae82a87a26089c51d9" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.310683 12416 raft_consensus.cc:2468] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7878f56361a947c08732561c97ca3165 in term 0.
23:49:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.310639 12921 raft_consensus.cc:515] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.311456 12921 leader_election.cc:290] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.311486 12626 leader_election.cc:304] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.311960 12921 raft_consensus.cc:2804] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.312119 12921 raft_consensus.cc:493] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.312222 12921 raft_consensus.cc:3060] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.312672 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc9cb02be0642fbb3d250accc6d86e6" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.312865 12416 raft_consensus.cc:2468] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7878f56361a947c08732561c97ca3165 in term 0.
23:49:11.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.313159 12914 tablet_bootstrap.cc:492] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165: No bootstrap required, opened a new log
23:49:11.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.313346 12914 ts_tablet_manager.cc:1403] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.001s
23:49:11.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.314764 12626 leader_election.cc:304] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.314388 12914 raft_consensus.cc:359] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.315086 12923 raft_consensus.cc:2804] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.315168 12914 raft_consensus.cc:385] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.315253 12923 raft_consensus.cc:493] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.315277 12914 raft_consensus.cc:740] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7878f56361a947c08732561c97ca3165, State: Initialized, Role: FOLLOWER
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.315382 12923 raft_consensus.cc:3060] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.315727 12914 consensus_queue.cc:260] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.317457 12914 ts_tablet_manager.cc:1434] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
23:49:11.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.320637 12914 tablet_bootstrap.cc:492] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165: Bootstrap starting.
23:49:11.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.322919 12914 tablet_bootstrap.cc:654] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165: Neither blocks nor log segments found. Creating new log.
23:49:11.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.323643 12923 raft_consensus.cc:515] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.324434 12923 leader_election.cc:290] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 election: Requested vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.325045 12921 raft_consensus.cc:515] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.325245 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc9cb02be0642fbb3d250accc6d86e6" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.325528 12416 raft_consensus.cc:3060] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.326113 12415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50a492114a341ae82a87a26089c51d9" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.326413 12415 raft_consensus.cc:3060] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.329599 12415 raft_consensus.cc:2468] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7878f56361a947c08732561c97ca3165 in term 1.
23:49:11.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.330549 12626 leader_election.cc:304] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.330739 12416 raft_consensus.cc:2468] T 4bc9cb02be0642fbb3d250accc6d86e6 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7878f56361a947c08732561c97ca3165 in term 1.
23:49:11.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.332126 12626 leader_election.cc:304] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.332558 12923 raft_consensus.cc:2804] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader election won for term 1
23:49:11.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.332876 12935 raft_consensus.cc:2804] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader election won for term 1
23:49:11.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:11.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.334539 12921 leader_election.cc:290] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 election: Requested vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:11.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.338078 12923 raft_consensus.cc:697] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [term 1 LEADER]: Becoming Leader. State: Replica: 7878f56361a947c08732561c97ca3165, State: Running, Role: LEADER
23:49:11.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.341180 12935 raft_consensus.cc:697] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [term 1 LEADER]: Becoming Leader. State: Replica: 7878f56361a947c08732561c97ca3165, State: Running, Role: LEADER
23:49:11.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.341566 12935 consensus_queue.cc:237] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.339346 12923 consensus_queue.cc:237] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.346222 12909 tablet_bootstrap.cc:492] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11: No bootstrap required, opened a new log
23:49:11.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.346585 12909 ts_tablet_manager.cc:1403] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent bootstrapping tablet: real 0.123s	user 0.004s	sys 0.005s
23:49:11.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.347554 12909 raft_consensus.cc:359] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.347863 12909 raft_consensus.cc:385] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.348019 12909 raft_consensus.cc:740] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Initialized, Role: FOLLOWER
23:49:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.348446 12909 consensus_queue.cc:260] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.349098 12909 ts_tablet_manager.cc:1434] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
23:49:11.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.351475 12909 tablet_bootstrap.cc:492] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11: Bootstrap starting.
23:49:11.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.353690 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50a492114a341ae82a87a26089c51d9" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" is_pre_election: true
23:49:11.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.354272 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc9cb02be0642fbb3d250accc6d86e6" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" is_pre_election: true
23:49:11.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.354655 12552 raft_consensus.cc:2468] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7878f56361a947c08732561c97ca3165 in term 0.
23:49:11.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.354008 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc9cb02be0642fbb3d250accc6d86e6" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:11.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.355177 12551 raft_consensus.cc:3060] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.355106 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50a492114a341ae82a87a26089c51d9" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:11.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.358247 12551 raft_consensus.cc:2468] T 4bc9cb02be0642fbb3d250accc6d86e6 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7878f56361a947c08732561c97ca3165 in term 1.
23:49:11.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.359158 12626 leader_election.cc:343] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585): Illegal state: must be running to vote when last-logged opid is not known
23:49:11.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.362229 12626 leader_election.cc:343] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585): Illegal state: must be running to vote when last-logged opid is not known
23:49:11.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.365496 12909 tablet_bootstrap.cc:654] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11: Neither blocks nor log segments found. Creating new log.
23:49:11.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468151369 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:11.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.369937 12236 catalog_manager.cc:5696] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7878f56361a947c08732561c97ca3165 (127.11.197.67). New cstate: current_term: 1 leader_uuid: "7878f56361a947c08732561c97ca3165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } health_report { overall_health: HEALTHY } } }
23:49:11.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.374507 12741 tablet.cc:2406] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:11.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.379941 12909 tablet_bootstrap.cc:492] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11: No bootstrap required, opened a new log
23:49:11.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.380118 12909 ts_tablet_manager.cc:1403] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.003s
23:49:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.380921 12909 raft_consensus.cc:359] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.381114 12909 raft_consensus.cc:385] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.381193 12909 raft_consensus.cc:740] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Initialized, Role: FOLLOWER
23:49:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.381456 12909 consensus_queue.cc:260] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.381969 12909 ts_tablet_manager.cc:1434] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
23:49:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.383147 12909 tablet_bootstrap.cc:492] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11: Bootstrap starting.
23:49:11.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.384924 12909 tablet_bootstrap.cc:654] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11: Neither blocks nor log segments found. Creating new log.
23:49:11.387 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
23:49:11.388 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.387042 12915 raft_consensus.cc:493] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.387254 12915 raft_consensus.cc:515] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.388082 12915 leader_election.cc:290] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.389334 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9bb7d6b54741d5aeebb76088d422fb" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" is_pre_election: true
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.389849 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9bb7d6b54741d5aeebb76088d422fb" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165" is_pre_election: true
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.390100 12693 raft_consensus.cc:2468] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94098e6939f4bbba635e95d3dd8f175 in term 0.
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.390941 12351 leader_election.cc:343] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585): Illegal state: must be running to vote when last-logged opid is not known
23:49:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.391439 12352 leader_election.cc:304] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175; no voters: 6847bb3ae6314e66a93b03b2d6b00e11
23:49:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.397101 12914 tablet_bootstrap.cc:492] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165: No bootstrap required, opened a new log
23:49:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.397280 12914 ts_tablet_manager.cc:1403] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.015s
23:49:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.398319 12914 raft_consensus.cc:359] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.398514 12914 raft_consensus.cc:385] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.398608 12914 raft_consensus.cc:740] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7878f56361a947c08732561c97ca3165, State: Initialized, Role: FOLLOWER
23:49:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.398864 12914 consensus_queue.cc:260] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.399987 12915 raft_consensus.cc:2804] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:11.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.400118 12915 raft_consensus.cc:493] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:11.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.400229 12915 raft_consensus.cc:3060] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.405345 12914 ts_tablet_manager.cc:1434] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
23:49:11.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.404713 12236 catalog_manager.cc:5696] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7878f56361a947c08732561c97ca3165 (127.11.197.67). New cstate: current_term: 1 leader_uuid: "7878f56361a947c08732561c97ca3165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } health_report { overall_health: HEALTHY } } }
23:49:11.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.407637 12914 tablet_bootstrap.cc:492] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165: Bootstrap starting.
23:49:11.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.409512 12914 tablet_bootstrap.cc:654] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165: Neither blocks nor log segments found. Creating new log.
23:49:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.412498 12915 raft_consensus.cc:515] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.413861 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9bb7d6b54741d5aeebb76088d422fb" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11"
23:49:11.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:11.414665 12351 leader_election.cc:343] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585): Illegal state: must be running to vote when last-logged opid is not known
23:49:11.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.415974 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9bb7d6b54741d5aeebb76088d422fb" candidate_uuid: "b94098e6939f4bbba635e95d3dd8f175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165"
23:49:11.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.416208 12693 raft_consensus.cc:3060] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.420249 12693 raft_consensus.cc:2468] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94098e6939f4bbba635e95d3dd8f175 in term 1.
23:49:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.420778 12352 leader_election.cc:304] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175; no voters: 6847bb3ae6314e66a93b03b2d6b00e11
23:49:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.421132 12926 raft_consensus.cc:2804] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader election won for term 1
23:49:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.423105 12909 tablet_bootstrap.cc:492] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11: No bootstrap required, opened a new log
23:49:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.423348 12909 ts_tablet_manager.cc:1403] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent bootstrapping tablet: real 0.040s	user 0.002s	sys 0.004s
23:49:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.424240 12909 raft_consensus.cc:359] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.424531 12909 raft_consensus.cc:385] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.424608 12909 raft_consensus.cc:740] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Initialized, Role: FOLLOWER
23:49:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.424875 12909 consensus_queue.cc:260] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.427690 12915 leader_election.cc:290] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [CANDIDATE]: Term 1 election: Requested vote from peers 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.430333 12909 ts_tablet_manager.cc:1434] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.000s
23:49:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.432305 12914 tablet_bootstrap.cc:492] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165: No bootstrap required, opened a new log
23:49:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.432566 12914 ts_tablet_manager.cc:1403] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
23:49:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.433998 12914 raft_consensus.cc:359] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.434235 12914 raft_consensus.cc:385] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.434315 12914 raft_consensus.cc:740] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7878f56361a947c08732561c97ca3165, State: Initialized, Role: FOLLOWER
23:49:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.434595 12909 tablet_bootstrap.cc:492] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11: Bootstrap starting.
23:49:11.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.434667 12914 consensus_queue.cc:260] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.443233 12914 ts_tablet_manager.cc:1434] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
23:49:11.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.444711 12909 tablet_bootstrap.cc:654] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11: Neither blocks nor log segments found. Creating new log.
23:49:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.445881 12926 raft_consensus.cc:697] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [term 1 LEADER]: Becoming Leader. State: Replica: b94098e6939f4bbba635e95d3dd8f175, State: Running, Role: LEADER
23:49:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.446517 12926 consensus_queue.cc:237] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.450413 12914 tablet_bootstrap.cc:492] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165: Bootstrap starting.
23:49:11.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.453073 12914 tablet_bootstrap.cc:654] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165: Neither blocks nor log segments found. Creating new log.
23:49:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.459789 12909 tablet_bootstrap.cc:492] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11: No bootstrap required, opened a new log
23:49:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.459630 12237 catalog_manager.cc:5696] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 reported cstate change: term changed from 0 to 1, leader changed from <none> to b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65). New cstate: current_term: 1 leader_uuid: "b94098e6939f4bbba635e95d3dd8f175" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } health_report { overall_health: UNKNOWN } } }
23:49:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.459983 12909 ts_tablet_manager.cc:1403] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.002s
23:49:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.460820 12909 raft_consensus.cc:359] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.461019 12909 raft_consensus.cc:385] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.461107 12909 raft_consensus.cc:740] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Initialized, Role: FOLLOWER
23:49:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.461375 12909 consensus_queue.cc:260] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.464892 12909 ts_tablet_manager.cc:1434] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.001s
23:49:11.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.475342 12914 tablet_bootstrap.cc:492] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165: No bootstrap required, opened a new log
23:49:11.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.475620 12914 ts_tablet_manager.cc:1403] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.002s
23:49:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.476531 12914 raft_consensus.cc:359] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.476734 12914 raft_consensus.cc:385] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.476828 12914 raft_consensus.cc:740] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7878f56361a947c08732561c97ca3165, State: Initialized, Role: FOLLOWER
23:49:11.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.477092 12914 consensus_queue.cc:260] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.480798 12914 ts_tablet_manager.cc:1434] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
23:49:11.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:11.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.546393 12923 raft_consensus.cc:493] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.546644 12923 raft_consensus.cc:515] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.547539 12923 leader_election.cc:290] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585)
23:49:11.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.548362 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474a770d457940f5adfafd47bc5383d4" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.548708 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474a770d457940f5adfafd47bc5383d4" candidate_uuid: "7878f56361a947c08732561c97ca3165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" is_pre_election: true
23:49:11.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.549064 12551 raft_consensus.cc:2393] T 474a770d457940f5adfafd47bc5383d4 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7878f56361a947c08732561c97ca3165 in current term 1: Already voted for candidate b94098e6939f4bbba635e95d3dd8f175 in this term.
23:49:11.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.551290 12626 leader_election.cc:304] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7878f56361a947c08732561c97ca3165; no voters: 6847bb3ae6314e66a93b03b2d6b00e11, b94098e6939f4bbba635e95d3dd8f175
23:49:11.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.551988 12923 raft_consensus.cc:3060] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.555503 12923 raft_consensus.cc:2749] T 474a770d457940f5adfafd47bc5383d4 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:49:11.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468151557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:11.566 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:11.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.567512 12913 raft_consensus.cc:493] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.567792 12913 raft_consensus.cc:515] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.570087 12913 leader_election.cc:290] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.572 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
23:49:11.583 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:11.583 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:11.584 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:11.584 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:11.584 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:11.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:11.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:11.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:11.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:11.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:11.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:11.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:11.585 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:11.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.593317 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9861564b964044d29589d20627bcaf84" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.593600 12416 raft_consensus.cc:2468] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 0.
23:49:11.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.594123 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9861564b964044d29589d20627bcaf84" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165" is_pre_election: true
23:49:11.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.594364 12693 raft_consensus.cc:2468] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 0.
23:49:11.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.594509 12488 leader_election.cc:304] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.595063 12913 raft_consensus.cc:2804] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.595188 12913 raft_consensus.cc:493] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.595288 12913 raft_consensus.cc:3060] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.598974 12913 raft_consensus.cc:515] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.600665 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9861564b964044d29589d20627bcaf84" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.600909 12416 raft_consensus.cc:3060] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.604683 12416 raft_consensus.cc:2468] T 9861564b964044d29589d20627bcaf84 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 1.
23:49:11.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.605276 12488 leader_election.cc:304] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.605995 12950 raft_consensus.cc:2804] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader election won for term 1
23:49:11.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.606110 12913 leader_election.cc:290] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 election: Requested vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.608472 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9861564b964044d29589d20627bcaf84" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165"
23:49:11.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.608716 12693 raft_consensus.cc:3060] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.611898 12693 raft_consensus.cc:2468] T 9861564b964044d29589d20627bcaf84 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 1.
23:49:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.615818 12950 raft_consensus.cc:697] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 LEADER]: Becoming Leader. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Running, Role: LEADER
23:49:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.616447 12950 consensus_queue.cc:237] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.622653 12237 catalog_manager.cc:5696] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66). New cstate: current_term: 1 leader_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } health_report { overall_health: UNKNOWN } } }
23:49:11.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.658084 12950 raft_consensus.cc:493] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.658327 12950 raft_consensus.cc:515] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.659186 12950 leader_election.cc:290] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.659718 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8fa8ace3754818987b888f909a9f95" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.659984 12416 raft_consensus.cc:2468] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 0.
23:49:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.660013 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8fa8ace3754818987b888f909a9f95" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165" is_pre_election: true
23:49:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.660262 12693 raft_consensus.cc:2468] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 0.
23:49:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.660746 12489 leader_election.cc:304] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11, 7878f56361a947c08732561c97ca3165; no voters: 
23:49:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.661079 12950 raft_consensus.cc:2804] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.661206 12950 raft_consensus.cc:493] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.661329 12950 raft_consensus.cc:3060] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.664134 12950 raft_consensus.cc:515] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.665047 12950 leader_election.cc:290] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 election: Requested vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.665678 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8fa8ace3754818987b888f909a9f95" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165"
23:49:11.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.665723 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8fa8ace3754818987b888f909a9f95" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175"
23:49:11.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.665904 12693 raft_consensus.cc:3060] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.665966 12416 raft_consensus.cc:3060] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.668342 12416 raft_consensus.cc:2468] T eb8fa8ace3754818987b888f909a9f95 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 1.
23:49:11.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.668310 12693 raft_consensus.cc:2468] T eb8fa8ace3754818987b888f909a9f95 P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6847bb3ae6314e66a93b03b2d6b00e11 in term 1.
23:49:11.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.668848 12488 leader_election.cc:304] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11, b94098e6939f4bbba635e95d3dd8f175; no voters: 
23:49:11.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.669165 12950 raft_consensus.cc:2804] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader election won for term 1
23:49:11.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.669349 12950 raft_consensus.cc:697] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 LEADER]: Becoming Leader. State: Replica: 6847bb3ae6314e66a93b03b2d6b00e11, State: Running, Role: LEADER
23:49:11.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.669651 12950 consensus_queue.cc:237] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.673199 12237 catalog_manager.cc:5696] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66). New cstate: current_term: 1 leader_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } health_report { overall_health: UNKNOWN } } }
23:49:11.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.711431 12950 raft_consensus.cc:493] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.711679 12950 raft_consensus.cc:515] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.712556 12950 leader_election.cc:290] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.713171 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50a492114a341ae82a87a26089c51d9" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165" is_pre_election: true
23:49:11.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.713321 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50a492114a341ae82a87a26089c51d9" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.713779 12416 raft_consensus.cc:2393] T e50a492114a341ae82a87a26089c51d9 P b94098e6939f4bbba635e95d3dd8f175 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6847bb3ae6314e66a93b03b2d6b00e11 in current term 1: Already voted for candidate 7878f56361a947c08732561c97ca3165 in this term.
23:49:11.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.714341 12488 leader_election.cc:304] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11; no voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175
23:49:11.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.714654 12950 raft_consensus.cc:3060] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.717005 12950 raft_consensus.cc:2749] T e50a492114a341ae82a87a26089c51d9 P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:49:11.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:11.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.728673 12923 consensus_queue.cc:1048] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.739742 12923 consensus_queue.cc:1048] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.770654 12950 raft_consensus.cc:493] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:11.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.770924 12950 raft_consensus.cc:515] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 } } peers { permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 } } peers { permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 } }
23:49:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.771873 12950 leader_election.cc:290] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387), 7878f56361a947c08732561c97ca3165 (127.11.197.67:46441)
23:49:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.772531 12416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9bb7d6b54741d5aeebb76088d422fb" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94098e6939f4bbba635e95d3dd8f175" is_pre_election: true
23:49:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.772558 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9bb7d6b54741d5aeebb76088d422fb" candidate_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7878f56361a947c08732561c97ca3165" is_pre_election: true
23:49:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.772801 12693 raft_consensus.cc:2393] T 8d9bb7d6b54741d5aeebb76088d422fb P 7878f56361a947c08732561c97ca3165 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6847bb3ae6314e66a93b03b2d6b00e11 in current term 1: Already voted for candidate b94098e6939f4bbba635e95d3dd8f175 in this term.
23:49:11.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.773357 12489 leader_election.cc:304] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6847bb3ae6314e66a93b03b2d6b00e11; no voters: 7878f56361a947c08732561c97ca3165, b94098e6939f4bbba635e95d3dd8f175
23:49:11.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.773710 12950 raft_consensus.cc:3060] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 0 FOLLOWER]: Advancing to term 1
23:49:11.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.776072 12950 raft_consensus.cc:2749] T 8d9bb7d6b54741d5aeebb76088d422fb P 6847bb3ae6314e66a93b03b2d6b00e11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
23:49:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.797081 12926 consensus_queue.cc:1048] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.802199 12923 consensus_queue.cc:1048] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.814561 12915 consensus_queue.cc:1048] T 474a770d457940f5adfafd47bc5383d4 P b94098e6939f4bbba635e95d3dd8f175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.815212 12935 consensus_queue.cc:1048] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:11.870 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468151869 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:11.877 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:49:11.877 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
23:49:11.933 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:11.934 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:11.934 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:11.934 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:11.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:11.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:11.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:11.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:11.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:11.934 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:11.934 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:11.934 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:11.934 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.962285 12915 consensus_queue.cc:1048] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6847bb3ae6314e66a93b03b2d6b00e11" member_type: VOTER last_known_addr { host: "127.11.197.66" port: 41585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:11.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:11.970925 12926 consensus_queue.cc:1048] T 8d9bb7d6b54741d5aeebb76088d422fb P b94098e6939f4bbba635e95d3dd8f175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:12.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:12.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468152057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:12.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:12.063217 12950 consensus_queue.cc:1048] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:12.065 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:12.066 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
23:49:12.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:12.071453 12913 consensus_queue.cc:1048] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:12.127 [DEBUG - main] (Connection.java:575) [peer master-127.11.23.253:46397(127.11.23.253:46397)] disconnecting while in state READY
23:49:12.127 [DEBUG - main] (Connection.java:575) [peer master-127.11.23.254:41819(127.11.23.254:41819)] disconnecting while in state READY
23:49:12.127 [DEBUG - main] (Connection.java:575) [peer master-127.11.23.252:40791(127.11.23.252:40791)] disconnecting while in state READY
23:49:12.127 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.23.253:46397(127.11.23.253:46397)] handling channelInactive
23:49:12.128 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state READY due to: connection closed
23:49:12.128 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:12.127 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.23.252:40791(127.11.23.252:40791)] handling channelInactive
23:49:12.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state READY due to: connection closed
23:49:12.129 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
23:49:12.129 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:49:12.130 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.23.254:41819(127.11.23.254:41819)] handling channelInactive
23:49:12.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state READY due to: connection closed
23:49:12.130 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:49:12.130 [DEBUG - main] (Connection.java:575) [peer master-127.11.197.125:42079(127.11.197.125:42079)] disconnecting while in state READY
23:49:12.130 [DEBUG - main] (Connection.java:575) [peer master-127.11.197.126:39201(127.11.197.126:39201)] disconnecting while in state READY
23:49:12.130 [DEBUG - main] (Connection.java:575) [peer master-127.11.197.124:40009(127.11.197.124:40009)] disconnecting while in state READY
23:49:12.131 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.197.126:39201(127.11.197.126:39201)] handling channelInactive
23:49:12.131 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.197.126:39201(127.11.197.126:39201)] cleaning up while in state READY due to: connection closed
23:49:12.131 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:12.131 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.197.125:42079(127.11.197.125:42079)] handling channelInactive
23:49:12.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.197.125:42079(127.11.197.125:42079)] cleaning up while in state READY due to: connection closed
23:49:12.133 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:49:12.133 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:12.138 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.197.124:40009(127.11.197.124:40009)] handling channelInactive
23:49:12.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.197.124:40009(127.11.197.124:40009)] cleaning up while in state READY due to: connection closed
23:49:12.139 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
23:49:12.141 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:12.141 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:49:12.141 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:49:12.142 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:12.142 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:12.143 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:12.150 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:49:12.151 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:49:12.151 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:49:12.151 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:49:12.151 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:49:12.151 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:49:12.151 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:49:12.183 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:12.183 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:12.183 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:12.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:12.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:12.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:12.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:12.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:12.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:12.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:12.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:12.185 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:12.185 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:12.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:12.209614 12951 consensus_queue.cc:1048] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7878f56361a947c08732561c97ca3165" member_type: VOTER last_known_addr { host: "127.11.197.67" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:12.214 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:12.215 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:12.215 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:12.215 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.215 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.215 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.216 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:12.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:12.218536 12913 consensus_queue.cc:1048] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94098e6939f4bbba635e95d3dd8f175" member_type: VOTER last_known_addr { host: "127.11.197.65" port: 44387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:12.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:12.291 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:12.292 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:12.292 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:12.292 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:12.292 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:12.292 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:12.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:12.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:12.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:12.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:12.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:12.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:12.293 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:12.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:12.336 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:12.336 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:12.336 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:12.336 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:12.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:12.337 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:12.337 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:12.337 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:12.337 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:12.337 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:12.337 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:12.337 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:12.337 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:12.375 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:12.375 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:12.375 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:12.376 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.376 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.377 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.377 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.379 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468152379 for job 86e770137b663b638a7b0ce49d5c917b.
23:49:12.380 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.380 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.380 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:12.381 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:49:12.395 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:12.396 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:12.396 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:12.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:12.396 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:12.397 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:12.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:12.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:12.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:12.399 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:12.399 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:12.399 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:12.399 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:12.405 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 86e770137b663b638a7b0ce49d5c917b (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
23:49:12.406 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
23:49:12.451 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:49:12.451 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:49:12.451 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:49:12.466 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:49:12.513 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:12.513 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:12.514 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:12.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:12.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:12.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:12.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:12.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:12.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:12.521 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:12.521 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:12.521 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:12.521 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:12.522 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:12.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468152557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:12.568 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:12.569 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
23:49:12.584 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.585 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.585 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.586 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.586 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.586 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.586 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.586 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.586 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.586 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.587 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29386), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [26ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [27ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [46ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [63ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [65ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [85ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [145ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [146ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [265ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [444ms] refreshing cache from master, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [446ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [446ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [824ms] refreshing cache from master, [824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [825ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [826ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1104ms] refreshing cache from master, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2163ms] refreshing cache from master, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2166ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2343ms] refreshing cache from master, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2346ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2347ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2347ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2863ms] refreshing cache from master, [2864ms] too many traces: truncated at 100 traces, deferred=Deferred@1161506320(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@6eb4d04b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498)))
23:49:12.588 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.589 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.589 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.589 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.589 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29386), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [26ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [27ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [46ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [63ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [65ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [85ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [145ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [146ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [265ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [444ms] refreshing cache from master, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [446ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [446ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [824ms] refreshing cache from master, [824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [825ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [826ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1104ms] refreshing cache from master, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2163ms] refreshing cache from master, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2166ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2343ms] refreshing cache from master, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2346ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2347ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2347ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2863ms] refreshing cache from master, [2864ms] too many traces: truncated at 100 traces, deferred=Deferred@1161506320(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@6eb4d04b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29386), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [26ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [27ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [46ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [63ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [65ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [85ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [145ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [146ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [265ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [444ms] refreshing cache from master, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [446ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [446ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [824ms] refreshing cache from master, [824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [825ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [826ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1104ms] refreshing cache from master, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2163ms] refreshing cache from master, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2166ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2343ms] refreshing cache from master, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2346ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2347ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2347ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2863ms] refreshing cache from master, [2864ms] too many traces: truncated at 100 traces, deferred=Deferred@1161506320(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@6eb4d04b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.7.104.125:36473
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:12.591 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.591 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.591 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.591 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.591 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.591 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.597 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:12.597 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:12.597 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:12.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:12.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:12.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:12.598 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:12.598 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:12.598 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:12.598 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:12.598 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:12.598 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:12.598 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:12.603 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29386), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [26ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [27ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [46ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [63ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [65ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [85ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [145ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [146ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [265ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [444ms] refreshing cache from master, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [446ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [446ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [824ms] refreshing cache from master, [824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [825ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [826ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1104ms] refreshing cache from master, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2163ms] refreshing cache from master, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2166ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2343ms] refreshing cache from master, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2346ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2347ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2347ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2863ms] refreshing cache from master, [2864ms] too many traces: truncated at 100 traces, deferred=Deferred@1161506320(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@6eb4d04b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=26, TimeoutTracker(timeout=30000, elapsed=29386), Traces: [0ms] sending RPC to server master-127.7.104.126:33577, [2ms] received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [24ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [26ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [27ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [27ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [44ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [46ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [46ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [63ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [65ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [65ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [84ms] refreshing cache from master, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [85ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [85ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [145ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [146ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [146ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [264ms] refreshing cache from master, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [265ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [265ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [444ms] refreshing cache from master, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [445ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [446ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [446ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [824ms] refreshing cache from master, [824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [825ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [826ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [826ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1104ms] refreshing cache from master, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [1104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [1105ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2163ms] refreshing cache from master, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2166ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2343ms] refreshing cache from master, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.125:36473, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.126:33577, [2344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.104.124:39307, [2345ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.125:36473: Network error: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473, [2346ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.126:33577: Network error: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577, [2347ms] Sub RPC ConnectToMaster: received response from server master-127.7.104.124:39307: Network error: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2347ms] delaying RPC due to: Service unavailable: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307, [2863ms] refreshing cache from master, [2864ms] too many traces: truncated at 100 traces, deferred=Deferred@1161506320(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@6eb4d04b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1979228238 after retry RPC after error@329952850) -> (continuation of Deferred@259869081 after retry RPC after error@1199826613) -> (continuation of Deferred@2001323227 after retry RPC after error@836185182) -> (continuation of Deferred@1417910908 after retry RPC after error@208496663) -> (continuation of Deferred@893065821 after retry RPC after error@1023833464) -> (continuation of Deferred@1964919006 after retry RPC after error@307538874) -> (continuation of Deferred@2135990879 after retry RPC after error@1903408504) -> (continuation of Deferred@1982614320 after retry RPC after error@1091708724) -> (continuation of Deferred@1001006867 after retry RPC after error@1461620075) -> (continuation of Deferred@1140799859 after retry RPC after error@327454143) -> (continuation of Deferred@2038215267 after retry RPC after error@1521094130) -> (continuation of Deferred@1621398389 after retry RPC after error@1476002731) -> (continuation of Deferred@1258904733 after retry RPC after error@1103502739) -> (continuation of Deferred@96272869 after retry RPC after error@39693730) -> (continuation of Deferred@53601472 after retry RPC after error@1927957424) -> (continuation of Deferred@523619873 after retry RPC after error@1886015704) -> (continuation of Deferred@2096217585 after retry RPC after error@1558629908) -> (continuation of Deferred@1838372719 after retry RPC after error@1339897493) -> (continuation of Deferred@1043469482 after retry RPC after error@1414462230) -> (continuation of Deferred@588379871 after retry RPC after error@98436534) -> (continuation of Deferred@728221411 after retry RPC after error@147984082) -> (continuation of Deferred@618247705 after retry RPC after error@1365243009) -> (continuation of Deferred@1150972055 after retry RPC after error@1546015304) -> (continuation of Deferred@900095659 after retry RPC after error@468934498)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.7.104.125:36473
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:12.604 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
23:49:12.604 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.604 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (86e770137b663b638a7b0ce49d5c917b) switched from state RUNNING to RESTARTING.
23:49:12.605 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.605 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.605 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.605 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
23:49:12.605 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
23:49:12.605 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.606 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.606 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
23:49:12.606 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:49:12.606 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
23:49:12.606 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
23:49:12.606 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:49:12.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
23:49:12.607 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
23:49:12.607 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
23:49:12.607 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
23:49:12.608 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.8.22.253:33181(127.8.22.253:33181)] disconnecting while in state TERMINATED
23:49:12.608 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.8.22.254:45201(127.8.22.254:45201)] disconnecting while in state TERMINATED
23:49:12.608 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] disconnecting while in state TERMINATED
23:49:12.608 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.8.22.252:44235(127.8.22.252:44235)] disconnecting while in state TERMINATED
23:49:12.608 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:12.609 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:49:12.609 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:49:12.609 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
23:49:12.609 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:49:12.610 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
23:49:12.610 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:49:12.611 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.8.22.253:33181(127.8.22.253:33181)] disconnecting while in state TERMINATED
23:49:12.611 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.8.22.254:45201(127.8.22.254:45201)] disconnecting while in state TERMINATED
23:49:12.611 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2100c738f2f94e4884d53e49614df1c4(127.8.22.193:34899)] disconnecting while in state TERMINATED
23:49:12.611 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.8.22.252:44235(127.8.22.252:44235)] disconnecting while in state TERMINATED
23:49:12.611 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:12.612 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:49:12.612 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-3
23:49:12.612 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:49:12.613 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:49:12.613 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
23:49:12.613 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:49:12.615 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.8.22.253:33181(127.8.22.253:33181)] disconnecting while in state TERMINATED
23:49:12.615 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.8.22.254:45201(127.8.22.254:45201)] disconnecting while in state TERMINATED
23:49:12.615 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.8.22.252:44235(127.8.22.252:44235)] disconnecting while in state TERMINATED
23:49:12.615 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:12.615 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:49:12.615 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:12.616 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:49:12.616 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
23:49:12.616 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:49:12.617 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.8.22.253:33181(127.8.22.253:33181)] disconnecting while in state TERMINATED
23:49:12.617 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.8.22.254:45201(127.8.22.254:45201)] disconnecting while in state TERMINATED
23:49:12.617 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.8.22.252:44235(127.8.22.252:44235)] disconnecting while in state TERMINATED
23:49:12.618 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:12.618 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
23:49:12.618 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:12.618 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:49:12.619 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:49:12.619 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
23:49:12.619 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:49:12.619 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
23:49:12.620 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
23:49:12.621 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:12.621 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
23:49:12.621 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:12.622 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
23:49:12.622 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:49:12.622 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:49:12.623 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
23:49:12.623 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
23:49:12.623 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:12.624 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:12.624 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
23:49:12.624 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:49:12.624 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
23:49:12.625 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
23:49:12.625 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.625 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.625 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:12.626 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.626 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.631 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:12.631 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
23:49:12.633 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
23:49:12.633 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:49:12.634 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
23:49:12.634 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
23:49:12.635 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 86e770137b663b638a7b0ce49d5c917b
23:49:12.645 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.645 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.645 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.647 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.647 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.647 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.647 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.664 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.664 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.664 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.664 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.665 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.665 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.684 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.684 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.684 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.685 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.685 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.685 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.685 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.685 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.685 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.685 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:12.744 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.745 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.745 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.745 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.746 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.746 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.805 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.806 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.807 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.807 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.807 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.807 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.807 [INFO - pool-118-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.808 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.808 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.809 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.809 [INFO - pool-118-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.809 [WARN - pool-118-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:12.826 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:12.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:12.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:12.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:12.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:12.828 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.829 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:12.829 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:12.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:12.984 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:12.984 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:12.984 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:12.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:12.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.985 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:12.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:12.985 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468153057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:13.066 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:13.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
23:49:13.196 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:13.196 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:13.196 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:13.196 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.196 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.196 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.197 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.197 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.197 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.197 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.197 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.197 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.197 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:13.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.224 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.224 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.225 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.225 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.281 [INFO - flink-pekko.actor.default-dispatcher-6] (Slf4jLogger.scala:117) Slf4jLogger started
23:49:13.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.364 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.364 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.364 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.364 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.365 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.365 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.420 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:49:13.436 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:13.436 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:13.436 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:13.437 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.437 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.437 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.437 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.437 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.437 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.437 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:13.446 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:49:13.469 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:49:13.481 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:49:13.488 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:13.488 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:13.488 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:13.489 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.489 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.489 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.489 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.489 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:13.503 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:49:13.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.517 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:49:13.518 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:49:13.518 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:49:13.519 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:49:13.519 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:49:13.519 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:49:13.519 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:49:13.519 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:49:13.520 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:49:13.520 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:49:13.520 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:49:13.520 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:49:13.520 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:49:13.520 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:49:13.520 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:49:13.521 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:49:13.521 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:49:13.521 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:49:13.521 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:49:13.521 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:49:13.521 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:49:13.522 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:49:13.522 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:49:13.522 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:49:13.523 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_904e5b9a3c7abda63d2ef86acf4544a6/blobStorage
23:49:13.523 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:36267 - max concurrent requests: 50 - max backlog: 1000
23:49:13.524 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_904e5b9a3c7abda63d2ef86acf4544a6/blobStorage
23:49:13.525 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_904e5b9a3c7abda63d2ef86acf4544a6/blobStorage
23:49:13.526 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:49:13.526 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: e4c46104-9bbc-4e54-8c11-8e462f9e36db
23:49:13.528 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:49:13.529 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-bb83c92b-a584-49b9-a4f8-c45018236565
23:49:13.530 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-b6d063be-48bd-496f-b17f-18a6d265bb30
23:49:13.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:13.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:13.536 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:13.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.537 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:13.537 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.537 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.537 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.537 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:13.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:13.537 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:13.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468153557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:13.569 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:49:13.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
23:49:13.596 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:49:13.597 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:49:13.597 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:49:13.597 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:49:13.598 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:49:13.599 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_20 .
23:49:13.604 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.605 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.605 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:127) Start job leader service.
23:49:13.605 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.605 [INFO - flink-pekko.actor.default-dispatcher-6] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-a6d0083a-4ca1-4c32-8501-c71c9abc30d2
23:49:13.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.617 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:13.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.617 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:13.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.617 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.617 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:49:13.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.617 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (86e770137b663b638a7b0ce49d5c917b) switched from state RESTARTING to RUNNING.
23:49:13.618 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.617 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:13.618 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:49:13.618 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 86e770137b663b638a7b0ce49d5c917b from Checkpoint 70 @ 1783468152379 for 86e770137b663b638a7b0ce49d5c917b located at file:/tmp/junit3801992595234658964/checkpoints/86e770137b663b638a7b0ce49d5c917b/chk-70.
23:49:13.618 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:13.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:13.618 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:13.619 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
23:49:13.619 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
23:49:13.619 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:13.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:13.619 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:13.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:13.620 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:13.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:13.620 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:13.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:13.620 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:13.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:13.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:13.620 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:13.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:13.620 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:13.620 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:13.620 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:13.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:13.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:13.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:13.620 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:13.623 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
23:49:13.624 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:13.624 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
23:49:13.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id 9fa644f0eaa1cd27a604255cca1b4463
23:49:13.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
23:49:13.625 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 9fa644f0eaa1cd27a604255cca1b4463.
23:49:13.625 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:13.625 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
23:49:13.626 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id 383e749a8070e650d1910d83d140e065
23:49:13.626 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
23:49:13.626 [INFO - Thread-49] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
23:49:13.626 [DEBUG - Thread-49] (Connection.java:575) [peer master-127.7.104.126:33577(127.7.104.126:33577)] disconnecting while in state TERMINATED
23:49:13.626 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 9fa644f0eaa1cd27a604255cca1b4463.
23:49:13.627 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:13.627 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
23:49:13.627 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id 2b79afe5d7cdb3b70c9ef47bd55ef49b
23:49:13.627 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
23:49:13.628 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 86e770137b663b638a7b0ce49d5c917b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:13.628 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
23:49:13.628 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to a4312e46-f932-4456-b154-6c9be007b3b6 @ 127.0.0.1 (dataPort=-1) with allocation id d429ceb379d5f3f058dc43e23b4a2944
23:49:13.628 [DEBUG - Thread-49] (Connection.java:575) [peer master-127.7.104.125:36473(127.7.104.125:36473)] disconnecting while in state TERMINATED
23:49:13.629 [DEBUG - Thread-49] (Connection.java:575) [peer master-127.7.104.124:39307(127.7.104.124:39307)] disconnecting while in state TERMINATED
23:49:13.629 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:13.629 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
23:49:13.629 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
23:49:13.630 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
23:49:13.631 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:49:13.631 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:49:13.631 [INFO - Thread-49] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
23:49:13.631 [INFO - Thread-49] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
23:49:13.635 [DEBUG - Thread-49] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.636 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 383e749a8070e650d1910d83d140e065.
23:49:13.637 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 383e749a8070e650d1910d83d140e065.
23:49:13.637 [INFO - Thread-49] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:49:13.638 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
23:49:13.638 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
23:49:13.638 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 2b79afe5d7cdb3b70c9ef47bd55ef49b.
23:49:13.639 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 2b79afe5d7cdb3b70c9ef47bd55ef49b.
23:49:13.639 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
23:49:13.640 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
23:49:13.640 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d429ceb379d5f3f058dc43e23b4a2944.
23:49:13.642 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id d429ceb379d5f3f058dc43e23b4a2944.
23:49:13.642 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
23:49:13.642 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
23:49:13.642 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:41237
23:49:13.642 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@706c4591
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.643 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@14e9352d
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:49:13.643 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@443f634a
23:49:13.644 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.644 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:49:13.644 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:49:13.645 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:49:13.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:49:13.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:49:13.645 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:49:13.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6670c8d6
23:49:13.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@c9d4eae
23:49:13.648 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@55ea4c47
23:49:13.649 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.650 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.651 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:13.651 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:13.651 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:13.651 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:13.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
23:49:13.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
23:49:13.652 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d7ab3b3
23:49:13.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit3801992595234658964/checkpoints")
23:49:13.652 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:49:13.653 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (40850a88b517955b2a1f2087427d3127_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:49:13.654 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e2e8675
23:49:13.655 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.655 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.656 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.660 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.661 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:49:13.661 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:41237 was granted leadership with leaderSessionID=6a0951b3-14fd-49bb-b3d1-9191970d7429
23:49:13.661 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:41237 , session=6a0951b3-14fd-49bb-b3d1-9191970d7429
23:49:13.663 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.665 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.667 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.667 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.671 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.671 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.672 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.672 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:49:13.672 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:49:13.672 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 80969132-da36-4f02-ae53-a84ad8c1ed9e. Creating new DispatcherLeaderProcess.
23:49:13.672 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:49:13.674 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.674 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.679 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.680 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.680 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.680 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.681 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.682 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:49:13.682 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:49:13.683 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.683 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.684 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.684 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.684 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.684 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.684 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_21 .
23:49:13.687 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.687 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.690 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_21 , session=80969132-da36-4f02-ae53-a84ad8c1ed9e
23:49:13.691 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:49:13.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.692 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.692 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.692 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.696 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.700 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.703 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.703 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.703 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.703 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.704 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.705 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.705 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.705 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.705 [INFO - pool-243-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 6487c215-2e5f-4a76-93c4-2f157563e09f.
23:49:13.707 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.708 [INFO - pool-243-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_22 .
23:49:13.709 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.709 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.711 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.711 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.711 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.712 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.712 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.714 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:253) Starting the resource manager.
23:49:13.715 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.719 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.720 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.721 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.721 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.722 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.723 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.723 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.723 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.723 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.724 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.724 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.724 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.724 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.728 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.732 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:49:13.732 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:49:13.733 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:49:13.733 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:49:13.733 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.733 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_22 , session=6487c215-2e5f-4a76-93c4-2f157563e09f
23:49:13.734 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.735 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.735 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(93c42f157563e09f6487c2152e5f4a76).
23:49:13.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.736 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.737 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.738 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.738 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.739 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.739 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.739 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.741 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.741 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.741 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.742 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.742 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.742 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.743 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:49:13.746 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (5a3070dbdd20ce404be391e5224b50fa).
23:49:13.747 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (5a3070dbdd20ce404be391e5224b50fa).
23:49:13.747 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-5a3070dbdd20ce404be391e5224b50fa'.
23:49:13.747 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.747 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.748 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.748 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.748 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 5a3070dbdd20ce404be391e5224b50fa was granted leadership with leader id a8efa87f-39d1-4a5c-9e4c-80b66794ed60. Creating new JobMasterServiceProcess.
23:49:13.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.749 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.749 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.749 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.749 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.749 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1080) Registering TaskManager with ResourceID e4c46104-9bbc-4e54-8c11-8e462f9e36db (pekko://flink/user/rpc/taskmanager_20) at ResourceManager
23:49:13.750 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_22 under registration id 846bc5fe4ffbc61b8db876baafe9806b.
23:49:13.750 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor e4c46104-9bbc-4e54-8c11-8e462f9e36db under 846bc5fe4ffbc61b8db876baafe9806b at the slot manager.
23:49:13.750 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.750 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.751 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.751 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.751 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.752 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.752 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_23 .
23:49:13.752 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.752 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.752 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.752 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.752 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.752 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.753 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.753 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.753 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.753 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.754 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.754 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.754 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.754 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.754 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.755 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.756 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.756 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.756 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.756 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.757 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (5a3070dbdd20ce404be391e5224b50fa).
23:49:13.758 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.758 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (5a3070dbdd20ce404be391e5224b50fa).
23:49:13.759 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph dcbad2e6e89fc464b992c754431db591 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.759 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (5a3070dbdd20ce404be391e5224b50fa).
23:49:13.759 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:49:13.760 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
23:49:13.761 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7916e6db
23:49:13.761 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.761 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.761 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13714335574893443082/checkpoints")
23:49:13.761 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.762 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.762 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.762 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.761 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.763 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.764 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:49:13.764 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@7c82d28f for Flink Streaming Job (5a3070dbdd20ce404be391e5224b50fa).
23:49:13.765 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_23 , session=a8efa87f-39d1-4a5c-9e4c-80b66794ed60
23:49:13.765 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (5a3070dbdd20ce404be391e5224b50fa) under job master id 9e4c80b66794ed60a8efa87f39d14a5c.
23:49:13.766 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:49:13.767 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.767 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.768 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.768 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:49:13.768 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5a3070dbdd20ce404be391e5224b50fa) switched from state CREATED to RUNNING.
23:49:13.768 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.769 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.769 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.769 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.769 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.769 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.769 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.769 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.769 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.771 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.771 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:13.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.776 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.776 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:49:13.776 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.776 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.776 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.776 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:49:13.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.776 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.777 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.777 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:49:13.777 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.777 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:49:13.776 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.777 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.777 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.777 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.777 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.777 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.777 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.777 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(93c42f157563e09f6487c2152e5f4a76)
23:49:13.777 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.778 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.778 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:13.778 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.779 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.779 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.779 [INFO - flink-pekko.actor.default-dispatcher-10] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:49:13.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.779 [INFO - flink-pekko.actor.default-dispatcher-10] (ResourceManager.java:390) Registering job manager 9e4c80b66794ed60a8efa87f39d14a5c@pekko://flink/user/rpc/jobmanager_23 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.780 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.23.254:41819(127.11.23.254:41819)] Successfully connected to peer
23:49:13.780 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.780 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.781 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.781 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.781 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.782 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.782 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.782 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.783 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.783 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.783 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.783 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.783 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.783 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.783 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.784 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.254
23:49:13.789 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:13.789 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.23.253:46397(127.11.23.253:46397)] Successfully connected to peer
23:49:13.790 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.790 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.790 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.790 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.790 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.790 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.792 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.792 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.792 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.792 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.792 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1015) Registered job manager 9e4c80b66794ed60a8efa87f39d14a5c@pekko://flink/user/rpc/jobmanager_23 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.793 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.794 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.794 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.792 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.795 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.796 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.796 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.796 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.796 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.796 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.797 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.798 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.798 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.798 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.798 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.798 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.798 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.798 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.802 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc2de6030, L:/127.0.0.1:47014 - R:/127.11.23.254:41819] using SASL/PLAIN
23:49:13.807 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 93c42f157563e09f6487c2152e5f4a76.
23:49:13.807 [DEBUG - main] (Connection.java:748) [peer master-127.11.197.125:42079(127.11.197.125:42079)] connecting to peer
23:49:13.808 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.808 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 5a3070dbdd20ce404be391e5224b50fa: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:13.808 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.808 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.808 [DEBUG - main] (Connection.java:748) [peer master-127.11.197.124:40009(127.11.197.124:40009)] connecting to peer
23:49:13.809 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.809 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.809 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.809 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.809 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.809 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.810 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.810 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.810 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.810 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.816 [DEBUG - main] (Connection.java:748) [peer master-127.11.197.126:39201(127.11.197.126:39201)] connecting to peer
23:49:13.816 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.816 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.817 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.817 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.197.124:40009(127.11.197.124:40009)] Successfully connected to peer
23:49:13.817 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.817 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.817 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.818 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.818 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.819 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 5a3070dbdd20ce404be391e5224b50fa
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager e4c46104-9bbc-4e54-8c11-8e462f9e36db
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:49:13.820 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 11294c1e7bd7561be4946d2592afb487 from e4c46104-9bbc-4e54-8c11-8e462f9e36db for job 5a3070dbdd20ce404be391e5224b50fa with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.820 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.820 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.803 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.23.252:40791(127.11.23.252:40791)] Successfully connected to peer
23:49:13.820 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f2f47466910da1fdaba93e8cf3aafd8a from e4c46104-9bbc-4e54-8c11-8e462f9e36db for job 5a3070dbdd20ce404be391e5224b50fa with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.820 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.821 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 11294c1e7bd7561be4946d2592afb487 for job 5a3070dbdd20ce404be391e5224b50fa from resource manager with leader id 93c42f157563e09f6487c2152e5f4a76.
23:49:13.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.821 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 11294c1e7bd7561be4946d2592afb487 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.822 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.822 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.822 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.822 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.252
23:49:13.822 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.253
23:49:13.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.823 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.823 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.823 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1127e8937eb4f5893d81a00c4b40c305 from e4c46104-9bbc-4e54-8c11-8e462f9e36db for job 5a3070dbdd20ce404be391e5224b50fa with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.824 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 106dc7f33bea79780cdf23a4ca617f5f from e4c46104-9bbc-4e54-8c11-8e462f9e36db for job 5a3070dbdd20ce404be391e5224b50fa with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.827 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.197.126:39201(127.11.197.126:39201)] Successfully connected to peer
23:49:13.827 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.828 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.828 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.828 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.828 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.829 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.829 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.829 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.832 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.834 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf6a1096e, L:/127.0.0.1:46154 - R:/127.11.23.253:46397] using SASL/PLAIN
23:49:13.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.836 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.836 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.837 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.837 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:13.837 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.837 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=66), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.254:41819, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.253:46397, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.23.252:40791, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.23.254:41819: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.23.253:46397: OK, deferred=null) after lookup
23:49:13.837 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.837 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.838 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.838 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.838 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.838 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.837 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.838 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.838 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.838 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.840 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:13.840 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd11408bf, L:/127.0.0.1:53244 - R:/127.11.23.252:40791] using SASL/PLAIN
23:49:13.841 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:192) Add job 5a3070dbdd20ce404be391e5224b50fa for job leader monitoring.
23:49:13.841 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_23 with leader id a8efa87f-39d1-4a5c-9e4c-80b66794ed60.
23:49:13.841 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request f2f47466910da1fdaba93e8cf3aafd8a for job 5a3070dbdd20ce404be391e5224b50fa from resource manager with leader id 93c42f157563e09f6487c2152e5f4a76.
23:49:13.841 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for f2f47466910da1fdaba93e8cf3aafd8a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.842 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 1127e8937eb4f5893d81a00c4b40c305 for job 5a3070dbdd20ce404be391e5224b50fa from resource manager with leader id 93c42f157563e09f6487c2152e5f4a76.
23:49:13.842 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 1127e8937eb4f5893d81a00c4b40c305 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.842 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 106dc7f33bea79780cdf23a4ca617f5f for job 5a3070dbdd20ce404be391e5224b50fa from resource manager with leader id 93c42f157563e09f6487c2152e5f4a76.
23:49:13.842 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 106dc7f33bea79780cdf23a4ca617f5f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:13.842 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:49:13.844 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_23 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.845 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.845 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.846 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:49:13.846 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e4c46104-9bbc-4e54-8c11-8e462f9e36db @ 127.0.0.1 (dataPort=-1) with allocation id 1127e8937eb4f5893d81a00c4b40c305
23:49:13.847 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1127e8937eb4f5893d81a00c4b40c305.
23:49:13.847 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.848 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.848 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:13.848 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.848 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:49:13.848 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.197.125:42079(127.11.197.125:42079)] Successfully connected to peer
23:49:13.848 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 5a3070dbdd20ce404be391e5224b50fa
23:49:13.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.848 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.848 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.849 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 1127e8937eb4f5893d81a00c4b40c305.
23:49:13.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.849 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.851 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:13.851 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:13.851 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:13.851 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:13.852 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:13.852 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:13.852 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:13.855 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.125
23:49:13.855 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.855 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.856 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.856 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.856 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.856 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.856 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.856 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.856 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.856 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.856 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.856 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.856 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.861 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.861 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.861 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.862 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.862 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.862 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.862 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.862 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.862 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.862 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.862 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.862 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.124
23:49:13.862 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.863 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:49:13.863 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e4c46104-9bbc-4e54-8c11-8e462f9e36db @ 127.0.0.1 (dataPort=-1) with allocation id 106dc7f33bea79780cdf23a4ca617f5f
23:49:13.863 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.126
23:49:13.866 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 106dc7f33bea79780cdf23a4ca617f5f.
23:49:13.867 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.868 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.868 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:49:13.868 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e4c46104-9bbc-4e54-8c11-8e462f9e36db @ 127.0.0.1 (dataPort=-1) with allocation id 11294c1e7bd7561be4946d2592afb487
23:49:13.868 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.868 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 106dc7f33bea79780cdf23a4ca617f5f.
23:49:13.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.868 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.869 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:49:13.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.869 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e4c46104-9bbc-4e54-8c11-8e462f9e36db @ 127.0.0.1 (dataPort=-1) with allocation id f2f47466910da1fdaba93e8cf3aafd8a
23:49:13.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.870 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.870 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.870 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.870 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.870 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:49:13.870 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:49:13.871 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.872 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4f7b727c, L:/127.0.0.1:34234 - R:/127.11.197.124:40009] using SASL/PLAIN
23:49:13.873 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf9b98a0d, L:/127.0.0.1:43830 - R:/127.11.197.125:42079] using SASL/PLAIN
23:49:13.874 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.874 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:13.874 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=71), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.125:42079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.124:40009, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.126:39201, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.124:40009: OK, deferred=null) after lookup
23:49:13.876 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.876 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.876 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.877 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.877 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.877 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.878 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1f2491ba
23:49:13.878 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.878 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13714335574893443082/checkpoints")
23:49:13.878 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:49:13.879 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:49:13.880 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfde64a17, L:/127.0.0.1:46072 - R:/127.11.197.126:39201] using SASL/PLAIN
23:49:13.882 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:13.890 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5a3070dbdd20ce404be391e5224b50fa since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5a3070dbdd20ce404be391e5224b50fa is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:13.891 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 11294c1e7bd7561be4946d2592afb487.
23:49:13.892 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:49:13.892 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:49:13.893 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49da9e38
23:49:13.893 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.893 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eb8fa8ace3754818987b888f909a9f95 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:13.893 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e50a492114a341ae82a87a26089c51d9 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:13.893 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:13.893 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:13.893 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:13.893 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:13.894 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=eb8fa8ace3754818987b888f909a9f95@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=e50a492114a341ae82a87a26089c51d9@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:13.894 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 11294c1e7bd7561be4946d2592afb487.
23:49:13.894 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.197.124:40009, [10ms] Sub RPC GetTableLocations: received response from server master-127.11.197.124:40009: OK, deferred=null)) after lookup
23:49:13.894 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] connecting to peer
23:49:13.895 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4b3a27c
23:49:13.896 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1127e8937eb4f5893d81a00c4b40c305.
23:49:13.896 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 106dc7f33bea79780cdf23a4ca617f5f.
23:49:13.896 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 11294c1e7bd7561be4946d2592afb487.
23:49:13.896 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot f2f47466910da1fdaba93e8cf3aafd8a.
23:49:13.896 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot f2f47466910da1fdaba93e8cf3aafd8a.
23:49:13.896 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:49:13.896 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:49:13.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@773b143c
23:49:13.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13714335574893443082/checkpoints")
23:49:13.897 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id f2f47466910da1fdaba93e8cf3aafd8a.
23:49:13.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:49:13.898 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:49:13.900 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] Successfully connected to peer
23:49:13.900 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13714335574893443082/checkpoints")
23:49:13.900 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:49:13.900 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:49:13.903 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5cc0eafe
23:49:13.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:49:13.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:49:13.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c4016fc
23:49:13.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:13.905 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13714335574893443082/checkpoints")
23:49:13.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:49:13.906 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:49:13.907 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.908 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.908 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.908 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:13.908 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.908 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:13.908 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:13.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.909 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.910 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.910 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.910 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.910 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.910 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.911 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@455df95
23:49:13.911 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.911 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.911 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:13.911 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.911 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:13.912 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.912 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.912 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:13.912 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:13.914 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@425e0fb7
23:49:13.915 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.11.197.125:42079(127.11.197.125:42079)] connecting to peer
23:49:13.916 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.917 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:13.918 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.11.197.124:40009(127.11.197.124:40009)] connecting to peer
23:49:13.919 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.197.125:42079(127.11.197.125:42079)] Successfully connected to peer
23:49:13.920 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.125
23:49:13.926 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.926 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.928 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.11.197.125:42079(127.11.197.125:42079)] connecting to peer
23:49:13.929 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa42526c9, L:/127.0.0.1:43836 - R:/127.11.197.125:42079] using SASL/PLAIN
23:49:13.929 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf86e2439, L:/127.0.0.1:53032 - R:/127.11.197.66:41585] using TOKEN/null
23:49:13.931 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.11.197.125:42079(127.11.197.125:42079)] connecting to peer
23:49:13.936 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.936 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.937 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.937 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.937 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.937 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.937 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:13.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.938 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:13.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.938 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.939 [DEBUG - main] (Connection.java:748) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] connecting to peer
23:49:13.940 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.940 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.940 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.941 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.941 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.941 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.941 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.942 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.11.197.125:42079(127.11.197.125:42079)] connecting to peer
23:49:13.942 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.11.197.126:39201(127.11.197.126:39201)] connecting to peer
23:49:13.943 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.11.197.124:40009(127.11.197.124:40009)] connecting to peer
23:49:13.943 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.197.125:42079(127.11.197.125:42079)] Successfully connected to peer
23:49:13.944 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.11.197.124:40009(127.11.197.124:40009)] connecting to peer
23:49:13.945 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.125
23:49:13.949 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.197.125:42079(127.11.197.125:42079)] Successfully connected to peer
23:49:13.954 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.955 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.197.124:40009(127.11.197.124:40009)] Successfully connected to peer
23:49:13.956 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa251d37c, L:/127.0.0.1:43848 - R:/127.11.197.125:42079] using SASL/PLAIN
23:49:13.961 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.125
23:49:13.964 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.124
23:49:13.969 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] Successfully connected to peer
23:49:13.969 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.970 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.970 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.971 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.972 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.975 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x652bed35, L:/127.0.0.1:34236 - R:/127.11.197.124:40009] using SASL/PLAIN
23:49:13.976 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:13.979 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x761c6e3e, L:/127.0.0.1:43862 - R:/127.11.197.125:42079] using SASL/PLAIN
23:49:13.980 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.11.197.124:40009(127.11.197.124:40009)] connecting to peer
23:49:13.981 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.197.125:42079(127.11.197.125:42079)] Successfully connected to peer
23:49:13.995 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:13.996 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:13.996 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:13.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.996 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.996 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:13.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.997 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.997 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:13.997 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.997 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.997 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:13.997 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:13.999 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.125
23:49:14.008 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.11.197.126:39201(127.11.197.126:39201)] connecting to peer
23:49:14.009 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.197.124:40009(127.11.197.124:40009)] Successfully connected to peer
23:49:14.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.011 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.124
23:49:14.015 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.197.126:39201(127.11.197.126:39201)] Successfully connected to peer
23:49:14.017 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.126
23:49:14.019 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.020 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.020 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.024 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x14a0db2f, L:/127.0.0.1:43866 - R:/127.11.197.125:42079] using SASL/PLAIN
23:49:14.026 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xa91d1ec0, L:/127.0.0.1:46924 - R:/127.11.197.67:46441] using TOKEN/null
23:49:14.039 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x09f79458, L:/127.0.0.1:34238 - R:/127.11.197.124:40009] using SASL/PLAIN
23:49:14.040 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.11.197.126:39201(127.11.197.126:39201)] connecting to peer
23:49:14.042 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:14.042 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=124), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.125:42079, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.124:40009, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.126:39201, [91ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.125:42079: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.124:40009: OK, deferred=null) after lookup
23:49:14.043 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.197.124:40009(127.11.197.124:40009)] Successfully connected to peer
23:49:14.044 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.045 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.045 [DEBUG - main] (Connection.java:748) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] connecting to peer
23:49:14.047 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:14.048 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:14.048 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:14.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.049 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.050 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:14.054 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.055 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.124
23:49:14.058 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.058 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32528292
23:49:14.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468154057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:14.059 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:49:14.059 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:49:14.062 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.062 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.062 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.063 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.063 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.064 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.068 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:14.070 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
23:49:14.070 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.197.126:39201(127.11.197.126:39201)] Successfully connected to peer
23:49:14.050 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.075 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.126
23:49:14.077 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x249a9901, L:/127.0.0.1:46088 - R:/127.11.197.126:39201] using SASL/PLAIN
23:49:14.081 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.082 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.11.197.126:39201(127.11.197.126:39201)] connecting to peer
23:49:14.083 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.197.124:40009(127.11.197.124:40009)] Successfully connected to peer
23:49:14.089 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.092 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.124
23:49:14.094 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xae3176da, L:/127.0.0.1:34250 - R:/127.11.197.124:40009] using SASL/PLAIN
23:49:14.097 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:14.098 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.125:42079, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.124:40009, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.125:42079: OK, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.126:39201, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.124:40009: OK, deferred=null) after lookup
23:49:14.098 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.197.126:39201(127.11.197.126:39201)] Successfully connected to peer
23:49:14.102 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.197.126
23:49:14.102 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.105 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x19368f31, L:/127.0.0.1:46100 - R:/127.11.197.126:39201] using SASL/PLAIN
23:49:14.105 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.105 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@228fed61
23:49:14.106 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:49:14.106 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:49:14.113 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.115 [DEBUG - kudu-nio-5] (Connection.java:757) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] Successfully connected to peer
23:49:14.124 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x6a893afd, L:/127.0.0.1:34266 - R:/127.11.197.124:40009] using SASL/PLAIN
23:49:14.132 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:14.132 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=223), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.125:42079, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.124:40009, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.125:42079: OK, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.126:39201, [209ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.124:40009: OK, deferred=null) after lookup
23:49:14.135 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.136 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.136 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.136 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.137 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.137 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.137 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.137 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.137 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.137 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.142 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.143 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:49:14.144 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='eabffdd067a1a012a1d100fff73dc7ffd6922061105610d4831044c27ca0a20e'}]
23:49:14.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.146 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:14.147 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:49:14.147 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0d96d016, L:/127.0.0.1:46104 - R:/127.11.197.126:39201] using SASL/PLAIN
23:49:14.148 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.148 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58b85db
23:49:14.149 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:49:14.149 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:49:14.151 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.152 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:49:14.153 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299993, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)[L],72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:14.154 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x4f2b9920, L:/127.0.0.1:41392 - R:/127.11.197.65:44387] using TOKEN/null
23:49:14.167 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:49:14.167 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1d736cf57c32ddc5b225947f69ce49d0502ba93e6e6a02962e30deccef92f014'}]
23:49:14.169 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:14.174 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:49:14.177 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.178 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.178 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.179 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.179 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.179 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.179 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.180 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.180 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.180 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.180 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.180 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.180 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.181 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.181 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.181 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.181 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.182 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.182 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.186 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.186 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.188 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:49:14.188 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8738973a58250835ffd9a409b92bc15b0484365cefd308410a1f0ddbf5741848'}]
23:49:14.190 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:14.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.194 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.194 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.199 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.199 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.206 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:49:14.206 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:14.206 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299993, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:14.216 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:49:14.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.221 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:49:14.222 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299993, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:14.243 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:14.246 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:14.251 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:14.251 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=346), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.125:42079, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.124:40009, [20ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.125:42079: OK, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.197.126:39201, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.197.124:40009: OK, deferred=null) after lookup
23:49:14.253 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:14.254 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.254 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.257 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:14.257 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.257 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.258 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@385af97d
23:49:14.260 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:49:14.260 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:49:14.261 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.197.126:39201(127.11.197.126:39201)] Successfully connected to peer
23:49:14.262 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.262 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.264 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.267 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.267 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.268 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:14.272 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.272 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.274 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xae5beb6f, L:/127.0.0.1:48560 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:14.284 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:14.288 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:14.288 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:14.289 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:14.289 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:14.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.290 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.290 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.290 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.290 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.290 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.290 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.291 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.291 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:14.292 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.292 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.303 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.307 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd36079f2, L:/127.0.0.1:46110 - R:/127.11.197.126:39201] using TOKEN/null
23:49:14.319 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305085557846016001) for scanner KuduScanner(table=replication_test_table, tablet=2c70b27918674dceb963e5732f243626, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.320 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [eabffdd067a1a012a1d100fff73dc7ffd6922061105610d4831044c27ca0a20e]
23:49:14.321 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:49:14.325 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [eabffdd067a1a012a1d100fff73dc7ffd6922061105610d4831044c27ca0a20e]
23:49:14.325 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:49:14.325 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:49:14.326 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:14.326 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split eabffdd067a1a012a1d100fff73dc7ffd6922061105610d4831044c27ca0a20e finished by subtask 3; deferring removal (restored in pending)
23:49:14.328 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:14.329 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ea750f58d71d476e24a7e875e8ba237dd692c6d2cee6fc5ad612576eeefcb89d'}]
23:49:14.330 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.332 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eb8fa8ace3754818987b888f909a9f95 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:14.332 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e50a492114a341ae82a87a26089c51d9 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:14.332 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:14.332 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.332 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.333 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.333 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=eb8fa8ace3754818987b888f909a9f95@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=e50a492114a341ae82a87a26089c51d9@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.333 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eb8fa8ace3754818987b888f909a9f95 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:14.333 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e50a492114a341ae82a87a26089c51d9 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:14.333 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9f4bd889, L:/127.0.0.1:48566 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:14.334 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:14.334 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.334 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.334 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.334 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=eb8fa8ace3754818987b888f909a9f95@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=e50a492114a341ae82a87a26089c51d9@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.336 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eb8fa8ace3754818987b888f909a9f95 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:14.336 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e50a492114a341ae82a87a26089c51d9 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:14.336 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:14.336 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.336 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.336 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.341 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=eb8fa8ace3754818987b888f909a9f95@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=e50a492114a341ae82a87a26089c51d9@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299995}]
23:49:14.342 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:14.346 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.346 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.346 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:49:14.347 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (dcbad2e6e89fc464b992c754431db591_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:49:14.347 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a1b60c580f15a44fdb4c83d64c74a1650f2969665a9fcb1a54a3b0f8041d5ead'}]
23:49:14.349 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:14.350 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085557846016001) for scanner KuduScanner(table=replication_test_table, tablet=9118d3334da544a9b81ad13815258bb0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.350 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [1d736cf57c32ddc5b225947f69ce49d0502ba93e6e6a02962e30deccef92f014]
23:49:14.350 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1d736cf57c32ddc5b225947f69ce49d0502ba93e6e6a02962e30deccef92f014]
23:49:14.351 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:49:14.351 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:49:14.351 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:14.352 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1d736cf57c32ddc5b225947f69ce49d0502ba93e6e6a02962e30deccef92f014 finished by subtask 1; deferring removal (restored in pending)
23:49:14.352 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.352 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.352 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:14.353 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2e58ec57330a6a932bcac0ebddb9b1ecf98c299b4590f4e55dee9febb0a3e7e2'}]
23:49:14.355 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:14.357 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.357 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.357 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.358 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.358 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.358 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.358 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.358 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.358 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.359 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.359 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.359 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:14.360 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.360 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.364 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:14.365 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.365 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.368 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.368 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.372 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.372 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.387 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468154388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:14.393 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa4fb8a40, L:/127.0.0.1:48572 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:14.413 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:14.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:14.413 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
23:49:14.413 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:49:14.423 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305085557846016001) for scanner KuduScanner(table=replication_test_table, tablet=c04afdb8853249d983c25348b5957f29, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.423 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [8738973a58250835ffd9a409b92bc15b0484365cefd308410a1f0ddbf5741848]
23:49:14.424 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:49:14.424 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299993, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:14.426 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.427 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.427 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.428 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.428 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.430 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.432 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.433 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.436 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.437 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.442 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.442 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@55b0ef2, flushNotification=Deferred@39409629(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:14.442 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.443 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] connecting to peer
23:49:14.447 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:49:14.449 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299993, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:14.451 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.451 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.456 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.456 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.456 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.457 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.457 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.457 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.458 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.458 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.458 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.458 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.459 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.459 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.469 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:49:14.472 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299993, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:14.498 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:14.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.512 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] Successfully connected to peer
23:49:14.516 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.516 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.521 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.521 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.523 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:14.532 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.533 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.537 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.537 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.540 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:49:14.543 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.543 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.544 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8738973a58250835ffd9a409b92bc15b0484365cefd308410a1f0ddbf5741848]
23:49:14.545 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8738973a58250835ffd9a409b92bc15b0484365cefd308410a1f0ddbf5741848 finished by subtask 2; deferring removal (restored in pending)
23:49:14.546 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.546 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:49:14.546 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:49:14.546 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:14.546 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:14.547 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:14.547 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.548 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.548 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.548 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.549 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.549 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.551 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe9ed6661, L:/127.0.0.1:53044 - R:/127.11.197.66:41585] using TOKEN/null
23:49:14.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468154556 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:14.566 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:14.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
23:49:14.572 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:14.589 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:14.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:14.590 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:14.590 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:49:14.595 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:14.598 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:14.603 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.603 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.618 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.618 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.624 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.624 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.627 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.628 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.631 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:14.631 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:14.632 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:14.632 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:49:14.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.639 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.646 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:14.646 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.646 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.647 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:14.648 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:14.648 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:14.648 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.648 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.649 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:14.649 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.649 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.649 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:14.649 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.649 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.650 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:14.650 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:14.652 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:14.691 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:14.701 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.702 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.706 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.706 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.710 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.710 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.713 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.713 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.718 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.719 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.724 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:14.728 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.730 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.731 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.736 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf1e0f677, L:/127.0.0.1:48574 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:14.736 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 5a3070dbdd20ce404be391e5224b50fa (5044 bytes, checkpointDuration=348 ms, finalizationTime=0 ms).
23:49:14.737 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:49:14.738 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split eabffdd067a1a012a1d100fff73dc7ffd6922061105610d4831044c27ca0a20e from pending
23:49:14.738 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 1d736cf57c32ddc5b225947f69ce49d0502ba93e6e6a02962e30deccef92f014 from pending
23:49:14.738 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 8738973a58250835ffd9a409b92bc15b0484365cefd308410a1f0ddbf5741848 from pending
23:49:14.738 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 3 finished splits from enumerator state
23:49:14.744 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.744 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.753 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2add9e2f, L:/127.0.0.1:48590 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:14.754 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305085557846016001) for scanner KuduScanner(table=replication_test_table, tablet=df4f4ad936b842fc99ba38d6e95bf42f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.754 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [2e58ec57330a6a932bcac0ebddb9b1ecf98c299b4590f4e55dee9febb0a3e7e2]
23:49:14.755 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:49:14.757 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2e58ec57330a6a932bcac0ebddb9b1ecf98c299b4590f4e55dee9febb0a3e7e2]
23:49:14.757 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:49:14.757 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:49:14.758 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:14.758 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2e58ec57330a6a932bcac0ebddb9b1ecf98c299b4590f4e55dee9febb0a3e7e2 finished by subtask 1; deferring removal (restored in pending)
23:49:14.759 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:14.760 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.760 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.765 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe313bd5d, L:/127.0.0.1:48582 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:14.778 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305085557846016001) for scanner KuduScanner(table=replication_test_table, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.779 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [a1b60c580f15a44fdb4c83d64c74a1650f2969665a9fcb1a54a3b0f8041d5ead]
23:49:14.779 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:49:14.787 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.787 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.787 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.787 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.788 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.788 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.788 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.788 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.788 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:14.789 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:14.789 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:14.789 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:14.792 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a1b60c580f15a44fdb4c83d64c74a1650f2969665a9fcb1a54a3b0f8041d5ead]
23:49:14.792 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.792 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.793 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a1b60c580f15a44fdb4c83d64c74a1650f2969665a9fcb1a54a3b0f8041d5ead finished by subtask 0; deferring removal (restored in pending)
23:49:14.796 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:49:14.796 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.797 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:49:14.797 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:14.797 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.797 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:14.802 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.802 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.802 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7305085557846016001) for scanner KuduScanner(table=replication_test_table, tablet=e2ed214849c145d89c8bef114ccf3020, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.802 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [ea750f58d71d476e24a7e875e8ba237dd692c6d2cee6fc5ad612576eeefcb89d]
23:49:14.803 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ea750f58d71d476e24a7e875e8ba237dd692c6d2cee6fc5ad612576eeefcb89d]
23:49:14.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:49:14.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:49:14.805 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ea750f58d71d476e24a7e875e8ba237dd692c6d2cee6fc5ad612576eeefcb89d finished by subtask 3; deferring removal (restored in pending)
23:49:14.805 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:14.810 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.810 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.810 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:14.815 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.815 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.816 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.816 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.817 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.817 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.817 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.817 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.818 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.827 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.827 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.828 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:14.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:14.828 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:14.829 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:49:14.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:14.863 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:14.863 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:49:14.863 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:14.864 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:14.883 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.883 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.889 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.890 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:14.890 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468154888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:14.893 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.893 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:14.894 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7448cbec, flushNotification=Deferred@332807702(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:14.895 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:14.895 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:14.895 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] connecting to peer
23:49:14.895 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:14.895 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=126, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@37aa8e29, flushNotification=Deferred@1571463961(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:14.895 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@19926179, flushNotification=Deferred@648675763(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:14.896 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] connecting to peer
23:49:14.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:14.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:14.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:14.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:14.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:14.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:14.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:14.897 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:14.897 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:14.897 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:14.897 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@380ec7be, flushNotification=Deferred@208104930(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:14.897 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.898 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] connecting to peer
23:49:14.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.899 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:14.899 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:49:14.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:14.899 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:49:14.898 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.902 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.902 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.902 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.902 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.903 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.904 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.904 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:14.908 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:14.908 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:14.908 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.908 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:14.908 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:14.909 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.909 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.909 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:14.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:14.909 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.910 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.910 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:14.910 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:14.913 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.913 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:14.949 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] Successfully connected to peer
23:49:14.953 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] Successfully connected to peer
23:49:14.968 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:14.968 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:14.970 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.975 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x7e3ece7f, L:/127.0.0.1:41396 - R:/127.11.197.65:44387] using TOKEN/null
23:49:14.968 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] Successfully connected to peer
23:49:14.986 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:14.987 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:14.987 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:14.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:14.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:14.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:14.988 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:14.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:14.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:14.989 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:14.989 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:14.989 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:14.989 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:14.991 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:14.993 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xcbf69285, L:/127.0.0.1:41398 - R:/127.11.197.65:44387] using TOKEN/null
23:49:15.000 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.000 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.004 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.004 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.008 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.008 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.016 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.017 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.025 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.025 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.026 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:15.033 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x157744f7, L:/127.0.0.1:46930 - R:/127.11.197.67:46441] using TOKEN/null
23:49:15.034 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:15.035 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:15.035 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:15.035 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:15.035 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:15.035 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:15.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:15.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:15.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:15.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:15.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:15.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:15.036 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:15.058 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:15.058 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:15.058 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:15.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.060 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.060 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:15.061 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468155057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:15.071 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:49:15.073 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
23:49:15.076 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:15.076 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:15.076 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:15.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:15.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:15.077 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:15.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:15.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:15.077 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:15.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:15.077 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:15.077 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:15.077 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:15.081 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:15.081 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:15.081 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:15.082 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.082 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.082 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.082 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.082 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.082 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.083 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.083 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:15.103 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.104 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:15.108 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.109 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.112 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.113 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.128 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:15.128 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:15.128 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:15.129 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:15.129 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:15.129 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:15.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:15.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:15.130 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:15.130 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:15.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:15.130 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:15.130 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:15.132 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.132 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.213 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:15.213 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:15.214 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:15.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:15.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:15.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:15.214 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:15.214 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:15.214 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:15.214 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:15.214 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:15.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:15.215 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:15.216 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.216 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.223 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:15.224202 12352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.197.67:46441, user_credentials={real_user=slave}} blocked reactor thread for 77794.1us
23:49:15.232 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 5a3070dbdd20ce404be391e5224b50fa (3004 bytes, checkpointDuration=343 ms, finalizationTime=1 ms).
23:49:15.234 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:49:15.234 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split ea750f58d71d476e24a7e875e8ba237dd692c6d2cee6fc5ad612576eeefcb89d from pending
23:49:15.234 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 2e58ec57330a6a932bcac0ebddb9b1ecf98c299b4590f4e55dee9febb0a3e7e2 from pending
23:49:15.234 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split a1b60c580f15a44fdb4c83d64c74a1650f2969665a9fcb1a54a3b0f8041d5ead from pending
23:49:15.234 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 3 finished splits from enumerator state
23:49:15.234 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.235 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:15.242779 12351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.197.66:41585, user_credentials={real_user=slave}} blocked reactor thread for 85560.9us
23:49:15.297 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.298 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:15.302 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.302 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.307 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.307 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.313 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.313 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.318 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.318 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.322 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.323 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.325 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:15.328 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:15.330 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:15.333 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:15.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.335 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:15.335 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:15.335 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:15.335 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:15.335 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:15.335 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:15.336 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:15.339 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eb8fa8ace3754818987b888f909a9f95 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:15.339 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e50a492114a341ae82a87a26089c51d9 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:15.339 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:15.339 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:15.339 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:15.339 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:15.340 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=eb8fa8ace3754818987b888f909a9f95@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=e50a492114a341ae82a87a26089c51d9@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:15.343 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:15.345 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 3c0ec8d82383476fbf1d402187840860
23:49:15.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:15.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:15.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:15.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:15.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:15.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:15.348 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:15.349 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.23.253:46397, [3ms] Sub RPC GetTableLocations: received response from server master-127.11.23.253:46397: OK, deferred=null)) after lookup
23:49:15.358 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2c70b27918674dceb963e5732f243626, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.358 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2c70b27918674dceb963e5732f243626 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:15.365 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9118d3334da544a9b81ad13815258bb0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.365 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 9118d3334da544a9b81ad13815258bb0 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.370 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c04afdb8853249d983c25348b5957f29, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.370 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet c04afdb8853249d983c25348b5957f29 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.375 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.375 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.378 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e2ed214849c145d89c8bef114ccf3020, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.379 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e2ed214849c145d89c8bef114ccf3020 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.382 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df4f4ad936b842fc99ba38d6e95bf42f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.382 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet df4f4ad936b842fc99ba38d6e95bf42f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eb8fa8ace3754818987b888f909a9f95 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e50a492114a341ae82a87a26089c51d9 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8d9bb7d6b54741d5aeebb76088d422fb for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4bc9cb02be0642fbb3d250accc6d86e6 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9861564b964044d29589d20627bcaf84 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 474a770d457940f5adfafd47bc5383d4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:15.385 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=eb8fa8ace3754818987b888f909a9f95@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=e50a492114a341ae82a87a26089c51d9@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=8d9bb7d6b54741d5aeebb76088d422fb@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=4bc9cb02be0642fbb3d250accc6d86e6@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441)[L],b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=9861564b964044d29589d20627bcaf84@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)[L],7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=474a770d457940f5adfafd47bc5383d4@[6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585),7878f56361a947c08732561c97ca3165(127.11.197.67:46441),b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=2), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.197.124:40009, [1ms] Sub RPC GetTableLocations: received response from server master-127.11.197.124:40009: OK, deferred=null)) after lookup
23:49:15.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468155388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:15.390 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.390 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:15.399 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.399 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.399 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:15.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:49:15.406 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.406 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.411 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.411 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.416 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.416 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.420 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.420 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.427 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2c70b27918674dceb963e5732f243626, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.427 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2c70b27918674dceb963e5732f243626 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:15.432 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9118d3334da544a9b81ad13815258bb0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.433 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 9118d3334da544a9b81ad13815258bb0 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.437 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c04afdb8853249d983c25348b5957f29, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.437 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet c04afdb8853249d983c25348b5957f29 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.448 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e2ed214849c145d89c8bef114ccf3020, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.449 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e2ed214849c145d89c8bef114ccf3020 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.457 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=df4f4ad936b842fc99ba38d6e95bf42f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.458 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet df4f4ad936b842fc99ba38d6e95bf42f for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.464 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eb8fa8ace3754818987b888f909a9f95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.464 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eb8fa8ace3754818987b888f909a9f95 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
23:49:15.476 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:15.476 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:15.476 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:15.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.477 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e50a492114a341ae82a87a26089c51d9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.477 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e50a492114a341ae82a87a26089c51d9 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
23:49:15.478 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.478 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.478 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.486 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:15.497 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:15.497 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:15.498 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:15.498 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:15.498 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:15.498 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:15.500 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:15.500 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:15.500 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:15.501 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:15.501 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:15.502 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:15.502 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:15.510 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8d9bb7d6b54741d5aeebb76088d422fb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.510 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8d9bb7d6b54741d5aeebb76088d422fb for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
23:49:15.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.526 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4bc9cb02be0642fbb3d250accc6d86e6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.526 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4bc9cb02be0642fbb3d250accc6d86e6 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
23:49:15.531 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9861564b964044d29589d20627bcaf84, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.532 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9861564b964044d29589d20627bcaf84 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
23:49:15.545 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=474a770d457940f5adfafd47bc5383d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.546 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 474a770d457940f5adfafd47bc5383d4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
23:49:15.546 [DEBUG - main] (Connection.java:575) [peer master-127.11.197.125:42079(127.11.197.125:42079)] disconnecting while in state READY
23:49:15.546 [DEBUG - main] (Connection.java:575) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] disconnecting while in state READY
23:49:15.546 [DEBUG - main] (Connection.java:575) [peer master-127.11.197.126:39201(127.11.197.126:39201)] disconnecting while in state READY
23:49:15.546 [DEBUG - main] (Connection.java:575) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] disconnecting while in state READY
23:49:15.547 [DEBUG - main] (Connection.java:575) [peer master-127.11.197.124:40009(127.11.197.124:40009)] disconnecting while in state READY
23:49:15.547 [DEBUG - main] (Connection.java:575) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] disconnecting while in state READY
23:49:15.547 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.197.125:42079(127.11.197.125:42079)] handling channelInactive
23:49:15.547 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.197.125:42079(127.11.197.125:42079)] cleaning up while in state READY due to: connection closed
23:49:15.547 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] handling channelInactive
23:49:15.547 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.197.126:39201(127.11.197.126:39201)] handling channelInactive
23:49:15.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] cleaning up while in state READY due to: connection closed
23:49:15.547 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.197.126:39201(127.11.197.126:39201)] cleaning up while in state READY due to: connection closed
23:49:15.548 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.197.124:40009(127.11.197.124:40009)] handling channelInactive
23:49:15.548 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.197.124:40009(127.11.197.124:40009)] cleaning up while in state READY due to: connection closed
23:49:15.549 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] handling channelInactive
23:49:15.549 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] cleaning up while in state READY due to: connection closed
23:49:15.552 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:15.553 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:15.553 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:15.554 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
23:49:15.554 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
23:49:15.554 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
23:49:15.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468155557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:15.565 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:15.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
23:49:15.571 [DEBUG - kudu-nio-5] (Connection.java:239) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] handling channelInactive
23:49:15.571 [DEBUG - kudu-nio-5] (Connection.java:709) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] cleaning up while in state READY due to: connection closed
23:49:15.571 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-5
23:49:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:15.572717 12053 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 12333
23:49:15.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:15.609856 12456 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:15.643 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:15.643 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:15.643 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:15.643 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:15.644 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:15.644 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:15.644 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:15.644 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:15.644 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:15.644 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:15.644 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:15.644 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:15.644 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:15.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.660 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:15.661 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:15.661 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:15.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:15.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.662 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:15.663 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.663 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.663 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:15.663 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:15.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:15.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:15.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:15.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:15.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:15.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:15.778 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:15.778 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
23:49:15.785 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cf87d49e5d42a7cb10fc19e764f5f3c8a456c57b60fdb8b61f99c7fa88709095'}]
23:49:15.786 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ba8a74a7537e2152f757a98ef28aeda5bb6fb8c969a72a2016853c94e854a565'}]
23:49:15.787 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:15.788 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8e9ad03759e6be598b65996fa669650e838702891860802525961100f657a718'}]
23:49:15.788 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:15.788 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:49:15.789 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:15.789 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299993, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:15.789 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ee50d2f8972f8339faa2eb79b10a186811eb9ef2b6f501cca9a2d2b0cee36423'}]
23:49:15.791 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:15.791 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
23:49:15.792 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299993, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)[L],72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:15.792 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:49:15.793 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299993, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:15.793 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:49:15.794 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299993, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:15.794 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:15.828 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:15.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:15.835 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:15.840 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:15.846 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:15.856 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:15.862 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:15.873 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:15.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468155888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:15.907 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 5a3070dbdd20ce404be391e5224b50fa (5104 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
23:49:15.909 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:15.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:49:15.913 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:15.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:15.916234 12053 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 12333
23:49:15.925 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:15.934 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:15.939 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:15.947 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:15.948 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:15.948 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:15.948 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:15.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:15.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:15.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:15.950 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:15.950 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:15.950 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:15.950 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:15.950 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:15.950 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:15.950 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:15.951 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:15.952 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7ddec651, L:/127.0.0.1:48594 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:15.953 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8dbc2edf, L:/127.0.0.1:48624 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:15.953 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd7d24c30, L:/127.0.0.1:48606 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:15.956 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:15.961 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x42bd49d1, L:/127.0.0.1:48620 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:15.972 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085566029824001) for scanner KuduScanner(table=replication_test_table, tablet=9118d3334da544a9b81ad13815258bb0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.973 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8e9ad03759e6be598b65996fa669650e838702891860802525961100f657a718]
23:49:15.973 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8e9ad03759e6be598b65996fa669650e838702891860802525961100f657a718]
23:49:15.974 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:49:15.974 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:49:15.975 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8e9ad03759e6be598b65996fa669650e838702891860802525961100f657a718 finished by subtask 1; deferring removal (restored in pending)
23:49:15.976 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:15.976 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9cff20aa7b0854ada0d1385c3236bd09026d87ef1b633fc84529c25476674dea'}]
23:49:15.978 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:15.979 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085566029824001) for scanner KuduScanner(table=replication_test_table, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:15.979 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:49:15.980 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299993, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:15.980 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [ee50d2f8972f8339faa2eb79b10a186811eb9ef2b6f501cca9a2d2b0cee36423]
23:49:15.980 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ee50d2f8972f8339faa2eb79b10a186811eb9ef2b6f501cca9a2d2b0cee36423]
23:49:15.981 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:49:15.981 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:49:15.981 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:15.982 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:15.982 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ee50d2f8972f8339faa2eb79b10a186811eb9ef2b6f501cca9a2d2b0cee36423 finished by subtask 3; deferring removal (restored in pending)
23:49:15.983 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f2b36233144dda83b0a8d3f1f3aeef3d66efd4336a8327026544066b6a2a731b'}]
23:49:15.983 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:15.984 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:15.985 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:15.988 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:49:15.989 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299993, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:16.003 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:16.005 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:16.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.016 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:16.018 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085566029824001) for scanner KuduScanner(table=replication_test_table, tablet=c04afdb8853249d983c25348b5957f29, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:16.019 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [ba8a74a7537e2152f757a98ef28aeda5bb6fb8c969a72a2016853c94e854a565]
23:49:16.019 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ba8a74a7537e2152f757a98ef28aeda5bb6fb8c969a72a2016853c94e854a565]
23:49:16.019 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085566029824001) for scanner KuduScanner(table=replication_test_table, tablet=2c70b27918674dceb963e5732f243626, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:16.019 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:49:16.019 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:49:16.019 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [cf87d49e5d42a7cb10fc19e764f5f3c8a456c57b60fdb8b61f99c7fa88709095]
23:49:16.019 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cf87d49e5d42a7cb10fc19e764f5f3c8a456c57b60fdb8b61f99c7fa88709095]
23:49:16.020 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
23:49:16.020 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
23:49:16.020 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:16.020 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ba8a74a7537e2152f757a98ef28aeda5bb6fb8c969a72a2016853c94e854a565 finished by subtask 0; deferring removal (restored in pending)
23:49:16.021 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cf87d49e5d42a7cb10fc19e764f5f3c8a456c57b60fdb8b61f99c7fa88709095 finished by subtask 2; deferring removal (restored in pending)
23:49:16.021 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:16.021 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:16.023 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:16.025 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:16.025 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:16.025 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:16.025 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:49:16.029 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe74f2325, L:/127.0.0.1:48638 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:16.032 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:16.032 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:16.032 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:16.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:16.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:16.032 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:16.032 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:16.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:16.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:16.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:16.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:16.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:16.033 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:16.034 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:16.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:16.035 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:16.035 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:49:16.041 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] handling channelInactive
23:49:16.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] cleaning up while in state READY due to: connection closed
23:49:16.041 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] handling channelInactive
23:49:16.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b94098e6939f4bbba635e95d3dd8f175(127.11.197.65:44387)] cleaning up while in state READY due to: connection closed
23:49:16.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.042701 12488 connection.cc:573] client connection to 127.11.197.65:44387 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:16.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.043044 12488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:16.048 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:16.048 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:16.048 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:49:16.050 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
23:49:16.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468156057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:16.068 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:16.070 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
23:49:16.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.071571 12626 connection.cc:573] client connection to 127.11.197.65:44387 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:16.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.071938 12626 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:16.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:16.080341 12053 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 12471
23:49:16.088 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085566029824001) for scanner KuduScanner(table=replication_test_table, tablet=e2ed214849c145d89c8bef114ccf3020, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:16.088 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [9cff20aa7b0854ada0d1385c3236bd09026d87ef1b633fc84529c25476674dea]
23:49:16.089 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9cff20aa7b0854ada0d1385c3236bd09026d87ef1b633fc84529c25476674dea]
23:49:16.089 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
23:49:16.089 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
23:49:16.090 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9cff20aa7b0854ada0d1385c3236bd09026d87ef1b633fc84529c25476674dea finished by subtask 1; deferring removal (restored in pending)
23:49:16.090 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:16.091 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.092501 13292 negotiation.cc:336] Failed RPC negotiation. Trace:
23:49:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.076186 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.197.65:44387 (local address 127.11.197.67:49389)
23:49:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.090021 (+ 13835us) negotiation.cc:107] Waiting for socket to connect
23:49:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.090264 (+   243us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.197.65:44387: connect: Connection reset by peer (error 104)
23:49:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":13666,"thread_start_us":14217,"threads_started":1}
23:49:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.092633 12488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.197.65:44387, user_credentials={real_user=slave}} blocked reactor thread for 49590us
23:49:16.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.094065 12626 consensus_peers.cc:597] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 -> Peer b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387): Couldn't send request to peer b94098e6939f4bbba635e95d3dd8f175. Status: Network error: Client connection negotiation failed: client connection to 127.11.197.65:44387: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
23:49:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.136567 12488 consensus_peers.cc:597] T 9861564b964044d29589d20627bcaf84 P 6847bb3ae6314e66a93b03b2d6b00e11 -> Peer b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387): Couldn't send request to peer b94098e6939f4bbba635e95d3dd8f175. Status: Network error: Client connection negotiation failed: client connection to 127.11.197.65:44387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:49:16.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.136802 12488 consensus_peers.cc:597] T eb8fa8ace3754818987b888f909a9f95 P 6847bb3ae6314e66a93b03b2d6b00e11 -> Peer b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387): Couldn't send request to peer b94098e6939f4bbba635e95d3dd8f175. Status: Network error: Client connection negotiation failed: client connection to 127.11.197.65:44387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:49:16.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:16.137678 12594 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:16.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.147 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:16.147 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:16.147 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:16.148 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:49:16.150 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:16.173 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:16.179 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:16.193 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:16.203 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x894bdca3, L:/127.0.0.1:48648 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:16.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:16.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:16.204 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:16.204 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:49:16.216 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085566029824001) for scanner KuduScanner(table=replication_test_table, tablet=df4f4ad936b842fc99ba38d6e95bf42f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:16.216 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [f2b36233144dda83b0a8d3f1f3aeef3d66efd4336a8327026544066b6a2a731b]
23:49:16.216 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f2b36233144dda83b0a8d3f1f3aeef3d66efd4336a8327026544066b6a2a731b]
23:49:16.217 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
23:49:16.217 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
23:49:16.218 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f2b36233144dda83b0a8d3f1f3aeef3d66efd4336a8327026544066b6a2a731b finished by subtask 3; deferring removal (restored in pending)
23:49:16.218 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:16.218 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:16.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.254 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:16.254 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:16.254 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:16.254 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:49:16.292 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:16.292 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:16.292 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:16.292 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:16.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:16.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:16.293 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:16.293 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:16.293 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:16.293 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:16.293 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:16.293 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:16.293 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:16.328 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:16.328 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:16.329 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:16.329 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:16.329 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:16.329 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:16.330 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:16.330 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:16.330 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:16.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:16.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:16.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:16.330 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:16.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.380028 12626 consensus_peers.cc:597] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 -> Peer b94098e6939f4bbba635e95d3dd8f175 (127.11.197.65:44387): Couldn't send request to peer b94098e6939f4bbba635e95d3dd8f175. Status: Network error: Client connection negotiation failed: client connection to 127.11.197.65:44387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:49:16.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468156388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:16.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 5a3070dbdd20ce404be391e5224b50fa (5104 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:16.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:49:16.402 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split f2b36233144dda83b0a8d3f1f3aeef3d66efd4336a8327026544066b6a2a731b from pending
23:49:16.402 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 8e9ad03759e6be598b65996fa669650e838702891860802525961100f657a718 from pending
23:49:16.402 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split cf87d49e5d42a7cb10fc19e764f5f3c8a456c57b60fdb8b61f99c7fa88709095 from pending
23:49:16.402 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split ee50d2f8972f8339faa2eb79b10a186811eb9ef2b6f501cca9a2d2b0cee36423 from pending
23:49:16.402 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split ba8a74a7537e2152f757a98ef28aeda5bb6fb8c969a72a2016853c94e854a565 from pending
23:49:16.403 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 9cff20aa7b0854ada0d1385c3236bd09026d87ef1b633fc84529c25476674dea from pending
23:49:16.403 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 6 finished splits from enumerator state
23:49:16.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.559 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468156557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:16.570 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
23:49:16.575 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
23:49:16.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:16.820523 12053 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 12471
23:49:16.830 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:16.830 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:16.830 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:16.831 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:16.831 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:16.831 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:16.832 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:16.832 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:16.832 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:16.832 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:16.832 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:16.832 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:16.832 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:16.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:16.840 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:16.841 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:16.841 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:16.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:16.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:16.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:16.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:16.842 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:16.842 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:16.843 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:16.843 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:16.843 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:16.843 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:16.869 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] handling channelInactive
23:49:16.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6847bb3ae6314e66a93b03b2d6b00e11(127.11.197.66:41585)] cleaning up while in state READY due to: connection closed
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.872403 12150 connection.cc:573] server connection from 127.11.197.66:54337 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.872696 13292 negotiation.cc:336] Failed RPC negotiation. Trace:
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.871392 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.197.66:41585 (local address 127.11.197.67:56035)
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.871765 (+   373us) negotiation.cc:107] Waiting for socket to connect
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.871788 (+    23us) client_negotiation.cc:175] Beginning negotiation
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.871940 (+   152us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0707 23:49:16.872475 (+   535us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.197.66:41585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":214}
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.873374 12626 consensus_peers.cc:597] T 4bc9cb02be0642fbb3d250accc6d86e6 P 7878f56361a947c08732561c97ca3165 -> Peer 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585): Couldn't send request to peer 6847bb3ae6314e66a93b03b2d6b00e11. Status: Network error: Client connection negotiation failed: client connection to 127.11.197.66:41585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
23:49:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:16.873509 12626 consensus_peers.cc:597] T e50a492114a341ae82a87a26089c51d9 P 7878f56361a947c08732561c97ca3165 -> Peer 6847bb3ae6314e66a93b03b2d6b00e11 (127.11.197.66:41585): Couldn't send request to peer 6847bb3ae6314e66a93b03b2d6b00e11. Status: Network error: Client connection negotiation failed: client connection to 127.11.197.66:41585: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
23:49:16.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:16.874377 12053 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 12609
23:49:16.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468156888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:16.903 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:49:16.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:49:16.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:16.928959 12733 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:16.953 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:16.954 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:16.954 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:16.955 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:16.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:16.955 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:16.955 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:16.955 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:16.955 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:16.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:16.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:16.956 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:16.956 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:17.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.063 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:17.064 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:17.064 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:17.064 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:17.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:17.064 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:17.064 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:17.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:17.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:17.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:17.065 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:17.065 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:17.065 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:17.066 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468157063 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:17.075 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:17.076 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
23:49:17.133 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:17.133 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:17.134 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:17.134 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:17.134 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:17.134 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:17.134 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:17.134 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:17.134 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:17.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:17.135 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:17.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:17.135 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:17.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.176 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:17.176 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:17.176 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:17.176 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:17.176 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:17.177 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:17.177 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:17.177 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:17.177 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:17.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:17.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:17.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:17.177 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:17.187 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:17.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:17.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:17.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:17.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:17.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:17.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:17.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:17.188 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:17.188 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:17.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:17.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:17.189 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:17.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.261559 12053 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 12609
23:49:17.275 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:17.275 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:17.276 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:17.279 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:17.279 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:17.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:17.295 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:17.295 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:17.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:17.296 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:17.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:17.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:17.296 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:17.310 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] handling channelInactive
23:49:17.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7878f56361a947c08732561c97ca3165(127.11.197.67:46441)] cleaning up while in state READY due to: connection closed
23:49:17.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:17.310675 12150 connection.cc:573] server connection from 127.11.197.67:47519 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:17.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.311491 12053 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 12064
23:49:17.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.312886 12125 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:17.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468157388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:17.408 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
23:49:17.410 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:49:17.468 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:17.468 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:17.468 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:17.469 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:17.469 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:17.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:17.470 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:17.470 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:17.470 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:17.470 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:17.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:17.470 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:17.470 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:17.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468157557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:17.566 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:17.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
23:49:17.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.585098 12053 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 12064
23:49:17.618 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.197.126:39201(127.11.197.126:39201)] handling channelInactive
23:49:17.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.197.126:39201(127.11.197.126:39201)] cleaning up while in state READY due to: connection closed
23:49:17.619 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.197.126:39201(127.11.197.126:39201)] handling channelInactive
23:49:17.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.197.126:39201(127.11.197.126:39201)] cleaning up while in state READY due to: connection closed
23:49:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.618734 12053 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 12132
23:49:17.618 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.197.126:39201(127.11.197.126:39201)] handling channelInactive
23:49:17.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.197.126:39201(127.11.197.126:39201)] cleaning up while in state READY due to: connection closed
23:49:17.619 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.197.126:39201(127.11.197.126:39201)] handling channelInactive
23:49:17.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.197.126:39201(127.11.197.126:39201)] cleaning up while in state READY due to: connection closed
23:49:17.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.620149 12196 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:17.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.727 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:17.727 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:17.728 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:17.728 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:17.728 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:17.728 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:17.728 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:17.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:17.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:17.728 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:17.728 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:17.729 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:17.729 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:17.773 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 5823fed25c0f4b50b2e2806ffb2181a6
23:49:17.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.776940 12053 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 12132
23:49:17.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2c70b27918674dceb963e5732f243626 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
23:49:17.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 9118d3334da544a9b81ad13815258bb0 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
23:49:17.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c04afdb8853249d983c25348b5957f29 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
23:49:17.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2fb4f8a4fa7b4419821bdd0e7a3095a1 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
23:49:17.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e2ed214849c145d89c8bef114ccf3020 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
23:49:17.777 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet df4f4ad936b842fc99ba38d6e95bf42f for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
23:49:17.782 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299995}]
23:49:17.785 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='34f9fbfcf5fd119fb89645e40f6276d2c245ee15f3a41779572aa963274ac647'}]
23:49:17.786 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='49f112745efece64dc10afc303c46d3d6efe05aac4c9ba7d43a546e3a6f45511'}]
23:49:17.786 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='79a339f0e7923d00a3775071a1833a88b40f76911c37f54421b4a04388a5ba60'}]
23:49:17.786 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7bed080ec649c8f9b3ad52d849907aac7ce45c6cb8e3e0d1a3a8941fdff4ec54'}]
23:49:17.787 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:17.787 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:17.788 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:49:17.788 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:17.788 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299993, tablet=2c70b27918674dceb963e5732f243626@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)[L],72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:17.788 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
23:49:17.789 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:17.789 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
23:49:17.789 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:17.790 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
23:49:17.790 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299993, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:17.791 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299993, tablet=9118d3334da544a9b81ad13815258bb0@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:17.791 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299993, tablet=c04afdb8853249d983c25348b5957f29@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:17.794 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:17.796 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:17.797 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:17.804 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:17.807 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:17.807 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4b763a6a, L:/127.0.0.1:48654 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:17.811 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:17.823 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:17.824 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.197.125:42079(127.11.197.125:42079)] handling channelInactive
23:49:17.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.197.125:42079(127.11.197.125:42079)] cleaning up while in state READY due to: connection closed
23:49:17.824 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.197.125:42079(127.11.197.125:42079)] handling channelInactive
23:49:17.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.197.125:42079(127.11.197.125:42079)] cleaning up while in state READY due to: connection closed
23:49:17.825 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.197.125:42079(127.11.197.125:42079)] handling channelInactive
23:49:17.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.197.125:42079(127.11.197.125:42079)] cleaning up while in state READY due to: connection closed
23:49:17.825 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.197.125:42079(127.11.197.125:42079)] handling channelInactive
23:49:17.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.197.125:42079(127.11.197.125:42079)] cleaning up while in state READY due to: connection closed
23:49:17.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.826030 12053 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 12203
23:49:17.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:17.827445 12268 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:17.830 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:17.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:17.835 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:17.836 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:17.840 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:17.850 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:17.853 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:17.855 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x53ce8d06, L:/127.0.0.1:48662 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:17.865 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:17.870 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfa00d2b5, L:/127.0.0.1:48656 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:17.872 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:17.881 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085574221824001) for scanner KuduScanner(table=replication_test_table, tablet=9118d3334da544a9b81ad13815258bb0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:17.882 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [79a339f0e7923d00a3775071a1833a88b40f76911c37f54421b4a04388a5ba60]
23:49:17.882 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [79a339f0e7923d00a3775071a1833a88b40f76911c37f54421b4a04388a5ba60]
23:49:17.883 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:49:17.883 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:49:17.883 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:17.884 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:17.895 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 79a339f0e7923d00a3775071a1833a88b40f76911c37f54421b4a04388a5ba60 finished by subtask 2; deferring removal (restored in pending)
23:49:17.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7a4332bb21e552df8f47fa29dccf68d4a0e4b115884c3319a7a1302c9bb4dcd7'}]
23:49:17.898 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468157894 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:17.908 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:17.914 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf4ef1ab7, L:/127.0.0.1:48672 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:17.916 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085574221824001) for scanner KuduScanner(table=replication_test_table, tablet=2fb4f8a4fa7b4419821bdd0e7a3095a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:17.920 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [7bed080ec649c8f9b3ad52d849907aac7ce45c6cb8e3e0d1a3a8941fdff4ec54]
23:49:17.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7bed080ec649c8f9b3ad52d849907aac7ce45c6cb8e3e0d1a3a8941fdff4ec54]
23:49:17.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
23:49:17.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
23:49:17.922 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7bed080ec649c8f9b3ad52d849907aac7ce45c6cb8e3e0d1a3a8941fdff4ec54 finished by subtask 3; deferring removal (restored in pending)
23:49:17.923 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:17.923 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f958db7afe111058a56868bbdf6d99f2a09584ce92fe82ee0eba6a1a94d9d202'}]
23:49:17.925 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:17.925 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:17.925 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
23:49:17.926 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299993, tablet=df4f4ad936b842fc99ba38d6e95bf42f@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)[L],28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)]}]
23:49:17.933 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085574221824001) for scanner KuduScanner(table=replication_test_table, tablet=c04afdb8853249d983c25348b5957f29, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:17.934 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [49f112745efece64dc10afc303c46d3d6efe05aac4c9ba7d43a546e3a6f45511]
23:49:17.934 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [49f112745efece64dc10afc303c46d3d6efe05aac4c9ba7d43a546e3a6f45511]
23:49:17.935 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
23:49:17.935 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
23:49:17.935 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 49f112745efece64dc10afc303c46d3d6efe05aac4c9ba7d43a546e3a6f45511 finished by subtask 1; deferring removal (restored in pending)
23:49:17.935 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:17.936 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:17.936 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:17.937 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:17.937 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:17.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:17.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:17.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:17.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:17.938 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:17.938 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:17.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:17.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:17.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:17.939 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:17.963 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:17.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:17.963 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:49:17.963 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
23:49:17.967 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:17.972 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
23:49:17.973 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299993, tablet=e2ed214849c145d89c8bef114ccf3020@[218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471),28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415),72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)[L]]}]
23:49:17.974 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:17.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:17.974 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:49:17.975 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:17.976 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 5a3070dbdd20ce404be391e5224b50fa (5104 bytes, checkpointDuration=82 ms, finalizationTime=0 ms).
23:49:17.977 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
23:49:17.977 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 79a339f0e7923d00a3775071a1833a88b40f76911c37f54421b4a04388a5ba60 from pending
23:49:17.977 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 7bed080ec649c8f9b3ad52d849907aac7ce45c6cb8e3e0d1a3a8941fdff4ec54 from pending
23:49:17.977 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 49f112745efece64dc10afc303c46d3d6efe05aac4c9ba7d43a546e3a6f45511 from pending
23:49:17.977 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
23:49:17.983 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:17.985 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:17.987 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] connecting to peer
23:49:17.995 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:17.995 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:17.996 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:17.996 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
23:49:18.003 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:18.003 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:18.004 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:18.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:18.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:18.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:18.005 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] Successfully connected to peer
23:49:18.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:18.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:18.005 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:18.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:18.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:18.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:18.007 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:18.007 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.23.194
23:49:18.010 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.016 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:18.019 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc1a35d75, L:/127.0.0.1:48694 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:18.023 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:18.028 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085574221824001) for scanner KuduScanner(table=replication_test_table, tablet=e2ed214849c145d89c8bef114ccf3020, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:18.028 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [7a4332bb21e552df8f47fa29dccf68d4a0e4b115884c3319a7a1302c9bb4dcd7]
23:49:18.028 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7a4332bb21e552df8f47fa29dccf68d4a0e4b115884c3319a7a1302c9bb4dcd7]
23:49:18.029 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
23:49:18.029 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
23:49:18.029 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcfd8759c, L:/127.0.0.1:48682 - R:/127.11.23.194:36415] using SASL/PLAIN
23:49:18.030 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7a4332bb21e552df8f47fa29dccf68d4a0e4b115884c3319a7a1302c9bb4dcd7 finished by subtask 2; deferring removal (restored in pending)
23:49:18.030 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:18.037 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:18.044 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:18.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:18.044 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:18.044 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
23:49:18.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468158057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:18.066 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:18.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
23:49:18.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.123296 12053 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 12203
23:49:18.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.150 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.197.124:40009(127.11.197.124:40009)] handling channelInactive
23:49:18.150 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.197.124:40009(127.11.197.124:40009)] handling channelInactive
23:49:18.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.197.124:40009(127.11.197.124:40009)] cleaning up while in state READY due to: connection closed
23:49:18.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.197.124:40009(127.11.197.124:40009)] cleaning up while in state READY due to: connection closed
23:49:18.151 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.197.124:40009(127.11.197.124:40009)] handling channelInactive
23:49:18.151 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.197.124:40009(127.11.197.124:40009)] cleaning up while in state READY due to: connection closed
23:49:18.151 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.197.124:40009(127.11.197.124:40009)] handling channelInactive
23:49:18.152 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.197.124:40009(127.11.197.124:40009)] cleaning up while in state READY due to: connection closed
23:49:18.155 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:18.155 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:18.155 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:18.156 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.156 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.156 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.156 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.156 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.156 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.157 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.157 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.157 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.157 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:18.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:18Z chronyd exiting
23:49:18.197 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085574221824001) for scanner KuduScanner(table=replication_test_table, tablet=2c70b27918674dceb963e5732f243626, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:18.197 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [34f9fbfcf5fd119fb89645e40f6276d2c245ee15f3a41779572aa963274ac647]
23:49:18.197 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [34f9fbfcf5fd119fb89645e40f6276d2c245ee15f3a41779572aa963274ac647]
23:49:18.198 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
23:49:18.198 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
23:49:18.199 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 34f9fbfcf5fd119fb89645e40f6276d2c245ee15f3a41779572aa963274ac647 finished by subtask 0; deferring removal (restored in pending)
23:49:18.199 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:18.200 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:18.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.228 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:18.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:18.228 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:18.228 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
23:49:18.299 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085574221824001) for scanner KuduScanner(table=replication_test_table, tablet=df4f4ad936b842fc99ba38d6e95bf42f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:18.300 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [f958db7afe111058a56868bbdf6d99f2a09584ce92fe82ee0eba6a1a94d9d202]
23:49:18.300 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f958db7afe111058a56868bbdf6d99f2a09584ce92fe82ee0eba6a1a94d9d202]
23:49:18.300 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
23:49:18.300 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
23:49:18.301 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f958db7afe111058a56868bbdf6d99f2a09584ce92fe82ee0eba6a1a94d9d202 finished by subtask 3; deferring removal (restored in pending)
23:49:18.303 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] disconnecting while in state READY
23:49:18.305 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:18.313 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:18.314 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:18.314 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:18.314 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.314 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.314 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.315 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.315 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.315 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.316 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:18.328 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] handling channelInactive
23:49:18.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 28d36357a2ff4787a4d62a32e1d749cb(127.11.23.194:36415)] cleaning up while in state READY due to: connection closed
23:49:18.329 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:18.329 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
23:49:18.332 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:18.332 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:18.332 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:18.332 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:18.332 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:18.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:18.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:18.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:18.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:18.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:18.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:18.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:18.333 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:18.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.355 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:18.355 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:18.355 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:18.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:18.356 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:18.356 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:18.356 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:18.356 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:18.356 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:18.357 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:18.357 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:18.357 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:18.357 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:18.362 [DEBUG - main] (Connection.java:575) [peer master-127.11.23.253:46397(127.11.23.253:46397)] disconnecting while in state READY
23:49:18.362 [DEBUG - main] (Connection.java:575) [peer master-127.11.23.254:41819(127.11.23.254:41819)] disconnecting while in state READY
23:49:18.362 [DEBUG - main] (Connection.java:575) [peer 218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)] disconnecting while in state READY
23:49:18.362 [DEBUG - main] (Connection.java:575) [peer 72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)] disconnecting while in state READY
23:49:18.362 [DEBUG - main] (Connection.java:575) [peer master-127.11.23.252:40791(127.11.23.252:40791)] disconnecting while in state READY
23:49:18.362 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.23.253:46397(127.11.23.253:46397)] handling channelInactive
23:49:18.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state READY due to: connection closed
23:49:18.363 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)] handling channelInactive
23:49:18.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 218317d0341d468eb24bf36793f2d4a6(127.11.23.193:42471)] cleaning up while in state READY due to: connection closed
23:49:18.363 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)] handling channelInactive
23:49:18.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 72e4797b3a554897bc93a0a707e1dd39(127.11.23.195:43301)] cleaning up while in state READY due to: connection closed
23:49:18.364 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:18.365 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.23.254:41819(127.11.23.254:41819)] handling channelInactive
23:49:18.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state READY due to: connection closed
23:49:18.365 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:49:18.365 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-1
23:49:18.365 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
23:49:18.366 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
23:49:18.366 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.23.252:40791(127.11.23.252:40791)] handling channelInactive
23:49:18.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state READY due to: connection closed
23:49:18.366 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:18.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.367205 11359 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 11642
23:49:18.388 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468158388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.398048 11764 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:18.401 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 5a3070dbdd20ce404be391e5224b50fa (3034 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:49:18.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
23:49:18.403 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 34f9fbfcf5fd119fb89645e40f6276d2c245ee15f3a41779572aa963274ac647 from pending
23:49:18.403 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 7a4332bb21e552df8f47fa29dccf68d4a0e4b115884c3319a7a1302c9bb4dcd7 from pending
23:49:18.403 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split f958db7afe111058a56868bbdf6d99f2a09584ce92fe82ee0eba6a1a94d9d202 from pending
23:49:18.403 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 3 finished splits from enumerator state
23:49:18.407 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:18.407 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:18.407 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.407 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:18.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.407 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.408 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:18.467 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:18.468 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:18.468 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:18.469 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.469 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.469 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.469 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.470 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.470 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.470 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:18.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.540 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:18.541 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:18.541 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:18.541 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.541 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.541 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.541 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.542 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.542 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.542 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:18.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468158557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:18.566 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:18.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
23:49:18.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.621866 11359 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 11642
23:49:18.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:18.661612 11934 connection.cc:573] server connection from 127.11.23.193:59059 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:18.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:18.662627 11932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.23.193:42471 (error 108)
23:49:18.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.663275 11359 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 11779
23:49:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:18.672230 11932 consensus_peers.cc:597] T 9118d3334da544a9b81ad13815258bb0 P 72e4797b3a554897bc93a0a707e1dd39 -> Peer 218317d0341d468eb24bf36793f2d4a6 (127.11.23.193:42471): Couldn't send request to peer 218317d0341d468eb24bf36793f2d4a6. Status: Network error: Client connection negotiation failed: client connection to 127.11.23.193:42471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
23:49:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.685248 11901 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:18.721 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.796 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:18.796 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:18.796 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:18.796 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:18.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.796 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:18.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:18.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:18.797 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:18.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.798 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:18.798 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.798 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:18.798 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:18.806 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:18.806 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:18.807 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:18.807 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.807 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.807 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.807 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.807 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.807 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.807 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.807 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.807 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.807 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:18.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:18.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.880964 11359 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 11779
23:49:18.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468158888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:18.896 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:18.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
23:49:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.918689 11359 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 11916
23:49:18.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:18.928419 12038 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:18.934 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:18.935 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:18.935 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.935 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.935 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:18.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:18.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:18.936 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:18.936 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:19.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468159057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:19.066 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:19.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
23:49:19.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.103955 11359 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 11916
23:49:19.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.133208 11359 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 11370
23:49:19.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.134541 11431 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:19.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.255157 11359 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 11370
23:49:19.279 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.23.254:41819(127.11.23.254:41819)] handling channelInactive
23:49:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.279503 11359 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 11438
23:49:19.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state READY due to: connection closed
23:49:19.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.280928 11503 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:19.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468159388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:19.397 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:19.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
23:49:19.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.408947 11359 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 11438
23:49:19.434 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.23.253:46397(127.11.23.253:46397)] handling channelInactive
23:49:19.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:19.434263 11530 connection.cc:573] server connection from 127.0.0.1:49822 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:19.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.434551 11359 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 11510
23:49:19.434 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state READY due to: connection closed
23:49:19.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.435868 11575 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:19.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.539 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:19.540 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:19.540 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:19.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:19.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:19.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:19.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:19.540 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:19.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:19.540 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:19.540 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:19.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:19.540 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:19.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468159557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:19.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:19.559762 11359 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 11510
23:49:19.587 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
23:49:19.588 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
23:49:19.591 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.23.252:40791(127.11.23.252:40791)] handling channelInactive
23:49:19.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state READY due to: connection closed
23:49:19.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:19Z chronyd exiting
23:49:19.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.687 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:19.688 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:19.688 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:19.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:19.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:19.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:19.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:19.689 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:19.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:19.689 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:19.689 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:19.689 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:19.689 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:19.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.23:49:19.741 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468159741
23:49:19.741 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783468159741
23:49:19.745 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:49:19.750 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:49:19.750 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:49:19.751 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:49:19.751 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:49:19.751 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:49:19.755 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:49:19.769 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.770 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.771 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.11.23.253:46397(127.11.23.253:46397) for tablet Kudu Master: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.792 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.793 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.793 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.794 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.794 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.794 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.794 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.794 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.794 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.795 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.795 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.795 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.795 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:19.813 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.813 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.814 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.815 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.815 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.815 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:19.832 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.832 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.833 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.833 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.833 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.833 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.833 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:19.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:19.852 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.852 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.853 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.853 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.853 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.853 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.853 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.853 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.853 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.853 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.853 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.853 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:19.872 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.872 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.873 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.873 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.873 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.873 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.873 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.873 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.873 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.874 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:19.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468159888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:19.898 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:19.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
23:49:19.901 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:19.901 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:19.901 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:19.901 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:19.901 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:19.901 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:19.901 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:19.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:19.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:19.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:19.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:19.901 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:19.902 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:19.912 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.912 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.913 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.913 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.913 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.913 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.913 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.913 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.913 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.913 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:19.935 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:19.936 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:19.936 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:19.936 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:19.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:19.936 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:19.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:19.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:19.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:19.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:19.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:19.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:19.936 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:19.952 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:19.952 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:19.953 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:19.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.953 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.953 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.953 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:19.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:19.953 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.953 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:19.953 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:20.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.056 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:20.056 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:20.056 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:20.056 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.056 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.056 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.056 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.057 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.057 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:20.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468160057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:20.065 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:20.066 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
23:49:20.093 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:20.093 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:20.093 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:20.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:20.094 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:20.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:20.094 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:20.094 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:20.094 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:20.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:20.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:20.094 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:20.094 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:20.107 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:20.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:20.108 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:20.108 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.108 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.108 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.108 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.108 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.108 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.109 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.109 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.109 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.109 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:20.132 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:20.132 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:20.133 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:20.133 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.133 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.133 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.133 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.133 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.133 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:20.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.147 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:20.147 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:49:20.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.149893 13392 mini_oidc.cc:150] Starting JWKS server
23:49:20.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.152908 13392 webserver.cc:534] Webserver started at http://127.0.0.1:42325/ using document root <none> and password file <none>
23:49:20.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.153169 13392 mini_oidc.cc:186] Starting OIDC Discovery server
23:49:20.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.153831 13392 webserver.cc:534] Webserver started at http://127.0.0.1:43665/ using document root <none> and password file <none>
23:49:20.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:20Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:49:20.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:20Z Disabled control of system clock
23:49:20.180 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:20.180 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:20.180 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:20.180 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:20.180 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:20.181 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:20.181 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:20.181 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:20.181 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:20.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:20.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:20.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:20.181 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.190382 13392 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/logs
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data/info.pb
23:49:20.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.62:35095
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.62
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:20.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42325/jwks.json with env {}
23:49:20.222 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.260 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:20.261 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:20.261 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:20.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:20.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:20.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:20.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:20.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:20.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:20.261 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:20.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:20.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:20.262 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:20.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.352 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:20.352 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:20.353 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:20.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.353 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.353 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.353 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.353 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.353 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.353 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.353 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.353 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.353 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:20.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468160388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:20.398 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:20.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
23:49:20.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.554 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:20.554 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:20.555 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:20.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:20.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:20.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:20.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:20.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:20.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:20.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:20.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:20.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:20.555 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:20.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468160557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:20.564 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
23:49:20.565 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
23:49:20.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.579551 13408 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:20.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.579958 13408 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:20.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.580066 13408 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.589498 13408 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.589603 13408 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.589663 13408 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.589705 13408 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.589761 13408 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.589795 13408 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42325/jwks.json
23:49:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.601425 13408 master_runner.cc:387] Master server non-default flags:
23:49:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.62:35095
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42325/jwks.json
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data/info.pb
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.62
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/logs
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.603331 13408 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:20.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.605473 13408 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.615269 13413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.615651 13416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.615293 13414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.616544 13408 server_base.cc:1061] running on GCE node
23:49:20.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.617393 13408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:20.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.619055 13408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:20.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.620301 13408 hybrid_clock.cc:648] HybridClock initialized: now 1783468160620254 us; error 33 us; skew 500 ppm
23:49:20.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.620726 13408 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:20.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.623471 13408 webserver.cc:534] Webserver started at http://127.13.20.62:36059/ using document root <none> and password file <none>
23:49:20.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.624369 13408 fs_manager.cc:362] Metadata directory not provided
23:49:20.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.624482 13408 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:20.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.624785 13408 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:20.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.627331 13408 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data/instance:
23:49:20.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a417bc9c09be44ddbc2eab679f648128"
23:49:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:20 on dist-test-slave-hfsf"
23:49:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.628243 13408 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal/instance:
23:49:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a417bc9c09be44ddbc2eab679f648128"
23:49:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:20 on dist-test-slave-hfsf"
23:49:20.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.634369 13408 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:49:20.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.638372 13422 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.640328 13408 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:49:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.640566 13408 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal
23:49:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a417bc9c09be44ddbc2eab679f648128"
23:49:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:20 on dist-test-slave-hfsf"
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.640810 13408 fs_report.cc:389] FS layout report
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data/data
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:20.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.653 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:20.653 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:20.653 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:20.653 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.653 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.655 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:20.659 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:20.660 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:20.660 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:20.660 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:20.660 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:20.660 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:20.660 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:20.660 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:20.660 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:20.660 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:20.660 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:20.660 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:20.660 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:20.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.673612 13408 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:20.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.674721 13408 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:20.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.675092 13408 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:20.676 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:20.676 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:20.676 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:20.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:20.677 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:20.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:20.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:20.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:20.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:20.677 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:20.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:20.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:20.677 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:20.683 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:20.683 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:20.683 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:20.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:20.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:20.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:20.684 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:20.684 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:20.684 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:20.684 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:20.684 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:20.684 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:20.684 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:20.692 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:20.692 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:20.692 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:20.693 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.693 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.693 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.693 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.693 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:20.693 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.693 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:20.693 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:20.693 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:20.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.703922 13473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.20.62:35095 every 8 connection(s)
23:49:20.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.703964 13408 rpc_server.cc:307] RPC server started. Bound to: 127.13.20.62:35095
23:49:20.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.705958 13408 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/data/info.pb
23:49:20.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.711513 13474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.712646 13392 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 13408
23:49:20.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.713040 13392 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-0/wal/instance
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.715866 13392 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/logs
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data/info.pb
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.61:45687
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.61
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42325/jwks.json with env {}
23:49:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.719180 13474 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } has no permanent_uuid. Determining permanent_uuid...
23:49:20.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.746084 13474 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } has no permanent_uuid. Determining permanent_uuid...
23:49:20.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.747519 13425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.20.61:45687: connect: Connection refused (error 111)
23:49:20.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.749598 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.61:45687: Network error: Client connection negotiation failed: client connection to 127.13.20.61:45687: connect: Connection refused (error 111)
23:49:20.763 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:20.763 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:20.764 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:20.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:20.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:20.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:20.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:20.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:20.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:20.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:20.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:20.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:20.764 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:20.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.798962 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } attempt: 1
23:49:20.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.801498 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.61:45687: Network error: Client connection negotiation failed: client connection to 127.13.20.61:45687: connect: Connection refused (error 111)
23:49:20.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:20.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.869823 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } attempt: 2
23:49:20.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.872355 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.61:45687: Network error: Client connection negotiation failed: client connection to 127.13.20.61:45687: connect: Connection refused (error 111)
23:49:20.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468160888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:20.899 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:20.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
23:49:20.932 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:20.932 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:20.933 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:20.933 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.933 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:20.933 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.933 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.933 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:20.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:20.934 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:20.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:20.963667 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } attempt: 3
23:49:20.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:20.966264 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.61:45687: Network error: Client connection negotiation failed: client connection to 127.13.20.61:45687: connect: Connection refused (error 111)
23:49:21.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468161057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:21.066 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:21.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
23:49:21.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.109537 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } attempt: 4
23:49:21.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.112161 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.61:45687: Network error: Client connection negotiation failed: client connection to 127.13.20.61:45687: connect: Connection refused (error 111)
23:49:21.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.112075 13476 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:21.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.112464 13476 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:21.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.112555 13476 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.121990 13476 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.122140 13476 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.122218 13476 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.122275 13476 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.122354 13476 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:21.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.122413 13476 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42325/jwks.json
23:49:21.132 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:21.133 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:21.133 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:21.133 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:21.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:21.133 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:21.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:21.133 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:21.133 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:21.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:21.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:21.134 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:21.134 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.135079 13476 master_runner.cc:387] Master server non-default flags:
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.61:45687
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42325/jwks.json
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data/info.pb
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.61
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/logs
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:21.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:21.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:21.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:21.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:21.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:21.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:21.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:21.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.137118 13476 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:21.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.139463 13476 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:21.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.149493 13484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:21.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.149531 13485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:21.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.153247 13487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:21.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.154431 13476 server_base.cc:1061] running on GCE node
23:49:21.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.155503 13476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:21.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.157362 13476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:21.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.158632 13476 hybrid_clock.cc:648] HybridClock initialized: now 1783468161158580 us; error 43 us; skew 500 ppm
23:49:21.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.159296 13476 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:21.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.162245 13476 webserver.cc:534] Webserver started at http://127.13.20.61:41575/ using document root <none> and password file <none>
23:49:21.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.163295 13476 fs_manager.cc:362] Metadata directory not provided
23:49:21.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.163439 13476 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:21.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.163888 13476 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.166563 13476 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data/instance:
23:49:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50ffa6f2e4b049d38574db4eedd3e419"
23:49:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:21 on dist-test-slave-hfsf"
23:49:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.167693 13476 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal/instance:
23:49:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50ffa6f2e4b049d38574db4eedd3e419"
23:49:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:21 on dist-test-slave-hfsf"
23:49:21.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.174679 13476 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:49:21.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.179527 13493 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:21.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.181525 13476 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.181743 13476 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50ffa6f2e4b049d38574db4eedd3e419"
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:21 on dist-test-slave-hfsf"
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.182039 13476 fs_report.cc:389] FS layout report
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data/data
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:21.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:21.193 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:21.193 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:21.194 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.194 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:21.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.194 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.194 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.194 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.194 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.194 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.194 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.194 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:21.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.216387 13476 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.217458 13476 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.217824 13476 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:21.221 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.241487 13476 rpc_server.cc:307] RPC server started. Bound to: 127.13.20.61:45687
23:49:21.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.241497 13544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.20.61:45687 every 8 connection(s)
23:49:21.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.243356 13476 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/data/info.pb
23:49:21.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.248358 13545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:21.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.250468 13392 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 13476
23:49:21.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.250618 13392 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-1/wal/instance
23:49:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.251705 13392 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal
23:49:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/logs
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data/info.pb
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.60:44081
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.60
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42325/jwks.json with env {}
23:49:21.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.255868 13545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.268 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:21.268 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:21.268 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:21.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:21.269 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:21.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:21.269 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:21.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:21.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:21.269 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:21.269 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:21.269 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:21.269 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:21.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.272258 13545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.283790 13545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.285398 13497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.287700 13545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.337101 13545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 1
23:49:21.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.339534 13545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.379 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:21.380 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:21.380 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:21.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:21.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:21.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:21.380 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:21.380 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:21.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:21.380 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:21.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:21.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:21.381 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:21.381 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28142), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [5ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [24ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [24ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [162ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [163ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [163ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [163ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [241ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [242ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [242ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [243ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [421ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [422ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [463ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [464ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [468ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [469ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [822ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1043ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4062ms] too many traces: truncated at 100 traces, deferred=Deferred@1216606794(state=PENDING, result=null, callback=(continuation of Deferred@1853395496 after retry RPC after error@107992949) -> (continuation of Deferred@266030416 after retry RPC after error@1478360899) -> (continuation of Deferred@1918820282 after retry RPC after error@183663355) -> (continuation of Deferred@1603667768 after retry RPC after error@1749425262) -> (continuation of Deferred@1818340819 after retry RPC after error@1977427718) -> (continuation of Deferred@438128962 after retry RPC after error@1113623299) -> (continuation of Deferred@588167593 after retry RPC after error@1073172441) -> (continuation of Deferred@1326489124 after retry RPC after error@158219350) -> (continuation of Deferred@1610288931 after retry RPC after error@1526139522) -> (continuation of Deferred@299716166 after retry RPC after error@1764314279) -> (continuation of Deferred@1848431798 after retry RPC after error@216887531) -> (continuation of Deferred@2008657998 after retry RPC after error@1423345258) -> (continuation of Deferred@1557618978 after retry RPC after error@995768443) -> (continuation of Deferred@31179934 after retry RPC after error@1641998105) -> (continuation of Deferred@107431025 after retry RPC after error@1813265702) -> (continuation of Deferred@867494670 after retry RPC after error@633615438) -> (continuation of Deferred@431798347 after retry RPC after error@1410091863) -> (continuation of Deferred@1089746499 after retry RPC after error@1150688343) -> (continuation of Deferred@940870254 after retry RPC after error@242497736) -> (continuation of Deferred@1876115819 after retry RPC after error@458464354) -> (continuation of Deferred@117977756 after retry RPC after error@680913101) -> (continuation of Deferred@1572355245 after retry RPC after error@1510935540) -> (continuation of Deferred@475352827 after retry RPC after error@461442620) -> (continuation of Deferred@121640117 after retry RPC after error@624094978) -> (continuation of Deferred@321281993 after retry RPC after error@4539263) -> (continuation of Deferred@128387710 after retry RPC after error@895463287), errback=(continuation of Deferred@1853395496 after retry RPC after error@107992949) -> (continuation of Deferred@266030416 after retry RPC after error@1478360899) -> (continuation of Deferred@1918820282 after retry RPC after error@183663355) -> (continuation of Deferred@1603667768 after retry RPC after error@1749425262) -> (continuation of Deferred@1818340819 after retry RPC after error@1977427718) -> (continuation of Deferred@438128962 after retry RPC after error@1113623299) -> (continuation of Deferred@588167593 after retry RPC after error@1073172441) -> (continuation of Deferred@1326489124 after retry RPC after error@158219350) -> (continuation of Deferred@1610288931 after retry RPC after error@1526139522) -> (continuation of Deferred@299716166 after retry RPC after error@1764314279) -> (continuation of Deferred@1848431798 after retry RPC after error@216887531) -> (continuation of Deferred@2008657998 after retry RPC after error@1423345258) -> (continuation of Deferred@1557618978 after retry RPC after error@995768443) -> (continuation of Deferred@31179934 after retry RPC after error@1641998105) -> (continuation of Deferred@107431025 after retry RPC after error@1813265702) -> (continuation of Deferred@867494670 after retry RPC after error@633615438) -> (continuation of Deferred@431798347 after retry RPC after error@1410091863) -> (continuation of Deferred@1089746499 after retry RPC after error@1150688343) -> (continuation of Deferred@940870254 after retry RPC after error@242497736) -> (continuation of Deferred@1876115819 after retry RPC after error@458464354) -> (continuation of Deferred@117977756 after retry RPC after error@680913101) -> (continuation of Deferred@1572355245 after retry RPC after error@1510935540) -> (continuation of Deferred@475352827 after retry RPC after error@461442620) -> (continuation of Deferred@121640117 after retry RPC after error@624094978) -> (continuation of Deferred@321281993 after retry RPC after error@4539263) -> (continuation of Deferred@128387710 after retry RPC after error@895463287)))
23:49:21.382 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
23:49:21.383 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28142), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [5ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [24ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [24ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [162ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [163ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [163ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [163ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [241ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [242ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [242ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [243ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [421ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [422ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [463ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [464ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [468ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [469ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [822ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1043ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4062ms] too many traces: truncated at 100 traces, deferred=Deferred@1216606794(state=PENDING, result=null, callback=(continuation of Deferred@1853395496 after retry RPC after error@107992949) -> (continuation of Deferred@266030416 after retry RPC after error@1478360899) -> (continuation of Deferred@1918820282 after retry RPC after error@183663355) -> (continuation of Deferred@1603667768 after retry RPC after error@1749425262) -> (continuation of Deferred@1818340819 after retry RPC after error@1977427718) -> (continuation of Deferred@438128962 after retry RPC after error@1113623299) -> (continuation of Deferred@588167593 after retry RPC after error@1073172441) -> (continuation of Deferred@1326489124 after retry RPC after error@158219350) -> (continuation of Deferred@1610288931 after retry RPC after error@1526139522) -> (continuation of Deferred@299716166 after retry RPC after error@1764314279) -> (continuation of Deferred@1848431798 after retry RPC after error@216887531) -> (continuation of Deferred@2008657998 after retry RPC after error@1423345258) -> (continuation of Deferred@1557618978 after retry RPC after error@995768443) -> (continuation of Deferred@31179934 after retry RPC after error@1641998105) -> (continuation of Deferred@107431025 after retry RPC after error@1813265702) -> (continuation of Deferred@867494670 after retry RPC after error@633615438) -> (continuation of Deferred@431798347 after retry RPC after error@1410091863) -> (continuation of Deferred@1089746499 after retry RPC after error@1150688343) -> (continuation of Deferred@940870254 after retry RPC after error@242497736) -> (continuation of Deferred@1876115819 after retry RPC after error@458464354) -> (continuation of Deferred@117977756 after retry RPC after error@680913101) -> (continuation of Deferred@1572355245 after retry RPC after error@1510935540) -> (continuation of Deferred@475352827 after retry RPC after error@461442620) -> (continuation of Deferred@121640117 after retry RPC after error@624094978) -> (continuation of Deferred@321281993 after retry RPC after error@4539263) -> (continuation of Deferred@128387710 after retry RPC after error@895463287), errback=(continuation of Deferred@1853395496 after retry RPC after error@107992949) -> (continuation of Deferred@266030416 after retry RPC after error@1478360899) -> (continuation of Deferred@1918820282 after retry RPC after error@183663355) -> (continuation of Deferred@1603667768 after retry RPC after error@1749425262) -> (continuation of Deferred@1818340819 after retry RPC after error@1977427718) -> (continuation of Deferred@438128962 after retry RPC after error@1113623299) -> (continuation of Deferred@588167593 after retry RPC after error@1073172441) -> (continuation of Deferred@1326489124 after retry RPC after error@158219350) -> (continuation of Deferred@1610288931 after retry RPC after error@1526139522) -> (continuation of Deferred@299716166 after retry RPC after error@1764314279) -> (continuation of Deferred@1848431798 after retry RPC after error@216887531) -> (continuation of Deferred@2008657998 after retry RPC after error@1423345258) -> (continuation of Deferred@1557618978 after retry RPC after error@995768443) -> (continuation of Deferred@31179934 after retry RPC after error@1641998105) -> (continuation of Deferred@107431025 after retry RPC after error@1813265702) -> (continuation of Deferred@867494670 after retry RPC after error@633615438) -> (continuation of Deferred@431798347 after retry RPC after error@1410091863) -> (continuation of Deferred@1089746499 after retry RPC after error@1150688343) -> (continuation of Deferred@940870254 after retry RPC after error@242497736) -> (continuation of Deferred@1876115819 after retry RPC after error@458464354) -> (continuation of Deferred@117977756 after retry RPC after error@680913101) -> (continuation of Deferred@1572355245 after retry RPC after error@1510935540) -> (continuation of Deferred@475352827 after retry RPC after error@461442620) -> (continuation of Deferred@121640117 after retry RPC after error@624094978) -> (continuation of Deferred@321281993 after retry RPC after error@4539263) -> (continuation of Deferred@128387710 after retry RPC after error@895463287)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.216.125:34537
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:21.383 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
23:49:21.386 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
23:49:21.388 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28142), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [2ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [5ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [24ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [24ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [43ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [102ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [162ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [163ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [163ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [163ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [241ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [242ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [242ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [243ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [421ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [422ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [463ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [464ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [468ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [469ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [822ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [822ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.125:34537: Network error: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.124:33041: Network error: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.2.216.126:46485: Network error: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [1043ms] delaying RPC due to: Service unavailable: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.125:34537, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.124:33041, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.216.126:46485, [4062ms] too many traces: truncated at 100 traces, deferred=Deferred@1216606794(state=PENDING, result=null, callback=(continuation of Deferred@1853395496 after retry RPC after error@107992949) -> (continuation of Deferred@266030416 after retry RPC after error@1478360899) -> (continuation of Deferred@1918820282 after retry RPC after error@183663355) -> (continuation of Deferred@1603667768 after retry RPC after error@1749425262) -> (continuation of Deferred@1818340819 after retry RPC after error@1977427718) -> (continuation of Deferred@438128962 after retry RPC after error@1113623299) -> (continuation of Deferred@588167593 after retry RPC after error@1073172441) -> (continuation of Deferred@1326489124 after retry RPC after error@158219350) -> (continuation of Deferred@1610288931 after retry RPC after error@1526139522) -> (continuation of Deferred@299716166 after retry RPC after error@1764314279) -> (continuation of Deferred@1848431798 after retry RPC after error@216887531) -> (continuation of Deferred@2008657998 after retry RPC after error@1423345258) -> (continuation of Deferred@1557618978 after retry RPC after error@995768443) -> (continuation of Deferred@31179934 after retry RPC after error@1641998105) -> (continuation of Deferred@107431025 after retry RPC after error@1813265702) -> (continuation of Deferred@867494670 after retry RPC after error@633615438) -> (continuation of Deferred@431798347 after retry RPC after error@1410091863) -> (continuation of Deferred@1089746499 after retry RPC after error@1150688343) -> (continuation of Deferred@940870254 after retry RPC after error@242497736) -> (continuation of Deferred@1876115819 after retry RPC after error@458464354) -> (continuation of Deferred@117977756 after retry RPC after error@680913101) -> (continuation of Deferred@1572355245 after retry RPC after error@1510935540) -> (continuation of Deferred@475352827 after retry RPC after error@461442620) -> (continuation of Deferred@121640117 after retry RPC after error@624094978) -> (continuation of Deferred@321281993 after retry RPC after error@4539263) -> (continuation of Deferred@128387710 after retry RPC after error@895463287), errback=(continuation of Deferred@1853395496 after retry RPC after error@107992949) -> (continuation of Deferred@266030416 after retry RPC after error@1478360899) -> (continuation of Deferred@1918820282 after retry RPC after error@183663355) -> (continuation of Deferred@1603667768 after retry RPC after error@1749425262) -> (continuation of Deferred@1818340819 after retry RPC after error@1977427718) -> (continuation of Deferred@438128962 after retry RPC after error@1113623299) -> (continuation of Deferred@588167593 after retry RPC after error@1073172441) -> (continuation of Deferred@1326489124 after retry RPC after error@158219350) -> (continuation of Deferred@1610288931 after retry RPC after error@1526139522) -> (continuation of Deferred@299716166 after retry RPC after error@1764314279) -> (continuation of Deferred@1848431798 after retry RPC after error@216887531) -> (continuation of Deferred@2008657998 after retry RPC after error@1423345258) -> (continuation of Deferred@1557618978 after retry RPC after error@995768443) -> (continuation of Deferred@31179934 after retry RPC after error@1641998105) -> (continuation of Deferred@107431025 after retry RPC after error@1813265702) -> (continuation of Deferred@867494670 after retry RPC after error@633615438) -> (continuation of Deferred@431798347 after retry RPC after error@1410091863) -> (continuation of Deferred@1089746499 after retry RPC after error@1150688343) -> (continuation of Deferred@940870254 after retry RPC after error@242497736) -> (continuation of Deferred@1876115819 after retry RPC after error@458464354) -> (continuation of Deferred@117977756 after retry RPC after error@680913101) -> (continuation of Deferred@1572355245 after retry RPC after error@1510935540) -> (continuation of Deferred@475352827 after retry RPC after error@461442620) -> (continuation of Deferred@121640117 after retry RPC after error@624094978) -> (continuation of Deferred@321281993 after retry RPC after error@4539263) -> (continuation of Deferred@128387710 after retry RPC after error@895463287)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.216.125:34537
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:21.390 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:21.390 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
23:49:21.390 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state RUNNING to RESTARTING.
23:49:21.391 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
23:49:21.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468161390 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:21.402 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:21.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
23:49:21.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.407838 13545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 2
23:49:21.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.410185 13545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.411453 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } attempt: 5
23:49:21.415 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:21.415 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:21.416 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:21.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:21.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:21.416 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:21.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:21.417 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:21.417 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:21.417 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:21.417 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:21.417 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:21.417 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:21.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.419709 13474 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.422114 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.454 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:21.455 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:21.455 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:21.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.456 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.456 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:21.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.473371 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 1
23:49:21.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.476009 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.501487 13545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 3
23:49:21.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.504112 13545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.510 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.544281 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 2
23:49:21.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.547215 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468161557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:21.565 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
23:49:21.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
23:49:21.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.647356 13545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 4
23:49:21.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.649616 13545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.653554 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 3
23:49:21.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.654563 13547 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:21.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.655269 13547 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:21.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.655427 13547 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:21.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.656428 13474 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.20.60:44081: Network error: Client connection negotiation failed: client connection to 127.13.20.60:44081: connect: Connection refused (error 111)
23:49:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.664968 13547 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.665096 13547 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.665181 13547 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.665230 13547 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.665283 13547 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.665318 13547 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42325/jwks.json
23:49:21.668 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:21.668 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:21.669 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:21.669 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:21.669 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:21.669 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:21.669 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:21.669 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:21.669 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:21.669 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:21.669 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:21.669 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:21.669 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.676802 13547 master_runner.cc:387] Master server non-default flags:
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.60:44081
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42325/jwks.json
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data/info.pb
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.60
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/logs
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.678671 13547 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:21.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.680907 13547 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:21.687 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:21.687 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:21.688 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:21.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.689 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:21.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.690918 13556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:21.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.691874 13557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:21.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.692337 13559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:21.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.693995 13547 server_base.cc:1061] running on GCE node
23:49:21.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.695065 13547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:21.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.696988 13547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:21.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.698288 13547 hybrid_clock.cc:648] HybridClock initialized: now 1783468161698197 us; error 74 us; skew 500 ppm
23:49:21.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.698952 13547 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:21.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.702172 13547 webserver.cc:534] Webserver started at http://127.13.20.60:36105/ using document root <none> and password file <none>
23:49:21.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.703372 13547 fs_manager.cc:362] Metadata directory not provided
23:49:21.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.703540 13547 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:21.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.704041 13547 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:21.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.707865 13547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data/instance:
23:49:21.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5c199b111a984b178c4429a4bfbee97a"
23:49:21.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:21 on dist-test-slave-hfsf"
23:49:21.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.709165 13547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal/instance:
23:49:21.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5c199b111a984b178c4429a4bfbee97a"
23:49:21.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:21 on dist-test-slave-hfsf"
23:49:21.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.717314 13547 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.003s
23:49:21.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.721740 13565 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.723835 13547 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.724071 13547 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5c199b111a984b178c4429a4bfbee97a"
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:21 on dist-test-slave-hfsf"
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.724365 13547 fs_report.cc:389] FS layout report
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data/data
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:21.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:21.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:21.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:21.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:21.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:21.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:21.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:21.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.754020 13547 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:21.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.755334 13547 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:21.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.755710 13547 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:21.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.781622 13547 rpc_server.cc:307] RPC server started. Bound to: 127.13.20.60:44081
23:49:21.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.781662 13616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.20.60:44081 every 8 connection(s)
23:49:21.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.783589 13547 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/data/info.pb
23:49:21.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.786089 13392 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 13547
23:49:21.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.786294 13392 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/master-2/wal/instance
23:49:21.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.789968 13617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:21.794 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:21.794 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:21.795 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:21.795 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.795 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.795 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:21.795 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.795 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.795 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:21.796 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.796 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.796 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:21.796 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:21.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.799131 13617 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.829659 13617 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.833639 13474 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 4
23:49:21.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:21.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.842900 13617 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } has no permanent_uuid. Determining permanent_uuid...
23:49:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.849206 13474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: Bootstrap starting.
23:49:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.853271 13474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: Neither blocks nor log segments found. Creating new log.
23:49:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.855232 13474 log.cc:826] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: Log is configured to *not* fsync() on all Append() calls
23:49:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.860795 13617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: Bootstrap starting.
23:49:21.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.864711 13617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: Neither blocks nor log segments found. Creating new log.
23:49:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.864908 13474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: No bootstrap required, opened a new log
23:49:21.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.865917 13617 log.cc:826] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: Log is configured to *not* fsync() on all Append() calls
23:49:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.868881 13617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: No bootstrap required, opened a new log
23:49:21.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.872783 13474 raft_consensus.cc:359] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:21.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.873092 13474 raft_consensus.cc:385] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:21.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.873183 13474 raft_consensus.cc:740] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a417bc9c09be44ddbc2eab679f648128, State: Initialized, Role: FOLLOWER
23:49:21.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.873916 13474 consensus_queue.cc:260] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:21.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.875053 13626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:21.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.875602 13626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: This master's current role is: FOLLOWER
23:49:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.876227 13617 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.876528 13474 sys_catalog.cc:565] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: configured and running, proceeding with master startup.
23:49:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.876618 13617 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.876749 13617 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c199b111a984b178c4429a4bfbee97a, State: Initialized, Role: FOLLOWER
23:49:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.877503 13617 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:21.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.884716 13628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:21.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.885140 13628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: This master's current role is: FOLLOWER
23:49:21.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.887508 13617 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: configured and running, proceeding with master startup.
23:49:21.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468161890 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:21.909 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
23:49:21.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
23:49:21.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.915396 13639 catalog_manager.cc:1593] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:21.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.915987 13639 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.914852 13408 master_runner.cc:187] Error getting master registration for 127.13.20.61:45687: OK, instance_id { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" instance_seqno: 1783468161235335 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:21.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.922855 13408 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:21.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.929627 13428 tablet.cc:2406] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:21.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.931051 13650 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:21.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:21.931219 13650 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:21.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.934737 13547 master_runner.cc:187] Error getting master registration for 127.13.20.61:45687: OK, instance_id { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" instance_seqno: 1783468161235335 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:21.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.942359 13547 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:21.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.948870 13545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } attempt: 5
23:49:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.964329 13545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: Bootstrap starting.
23:49:21.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.969991 13545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: Neither blocks nor log segments found. Creating new log.
23:49:21.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.971760 13545 log.cc:826] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: Log is configured to *not* fsync() on all Append() calls
23:49:21.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.975762 13545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: No bootstrap required, opened a new log
23:49:21.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.989678 13545 raft_consensus.cc:359] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:21.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.990146 13545 raft_consensus.cc:385] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:21.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.990279 13545 raft_consensus.cc:740] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ffa6f2e4b049d38574db4eedd3e419, State: Initialized, Role: FOLLOWER
23:49:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.991174 13545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:21.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.992398 13653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:21.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.993099 13653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: This master's current role is: FOLLOWER
23:49:21.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:21.994217 13545 sys_catalog.cc:565] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: configured and running, proceeding with master startup.
23:49:22.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.008499 13571 tablet.cc:2406] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:22.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:22.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.042771 13628 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:22.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.043154 13628 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:22.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.045118 13628 leader_election.cc:290] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a417bc9c09be44ddbc2eab679f648128 (127.13.20.62:35095), 50ffa6f2e4b049d38574db4eedd3e419 (127.13.20.61:45687)
23:49:22.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.047209 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c199b111a984b178c4429a4bfbee97a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a417bc9c09be44ddbc2eab679f648128" is_pre_election: true
23:49:22.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.047887 13449 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c199b111a984b178c4429a4bfbee97a in term 0.
23:49:22.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.049311 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c199b111a984b178c4429a4bfbee97a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ffa6f2e4b049d38574db4eedd3e419" is_pre_election: true
23:49:22.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.049937 13520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c199b111a984b178c4429a4bfbee97a in term 0.
23:49:22.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.052950 13568 leader_election.cc:304] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ffa6f2e4b049d38574db4eedd3e419, 5c199b111a984b178c4429a4bfbee97a; no voters: 
23:49:22.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.053455 13628 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:22.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.053628 13628 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:22.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.053781 13628 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 0 FOLLOWER]: Advancing to term 1
23:49:22.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468162057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:22.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.057926 13628 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:22.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.059434 13628 leader_election.cc:290] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [CANDIDATE]: Term 1 election: Requested vote from peers a417bc9c09be44ddbc2eab679f648128 (127.13.20.62:35095), 50ffa6f2e4b049d38574db4eedd3e419 (127.13.20.61:45687)
23:49:22.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.068125 13476 master_runner.cc:233] Existing masters have differing terms: 0 vs 1
23:49:22.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.068464 13476 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:22.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.069079 13520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c199b111a984b178c4429a4bfbee97a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ffa6f2e4b049d38574db4eedd3e419"
23:49:22.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.069363 13520 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 0 FOLLOWER]: Advancing to term 1
23:49:22.071 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
23:49:22.072 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
23:49:22.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.072791 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c199b111a984b178c4429a4bfbee97a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a417bc9c09be44ddbc2eab679f648128"
23:49:22.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.073071 13449 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 0 FOLLOWER]: Advancing to term 1
23:49:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.083460 13520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c199b111a984b178c4429a4bfbee97a in term 1.
23:49:22.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.084355 13449 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c199b111a984b178c4429a4bfbee97a in term 1.
23:49:22.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.085192 13568 leader_election.cc:304] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ffa6f2e4b049d38574db4eedd3e419, 5c199b111a984b178c4429a4bfbee97a; no voters: 
23:49:22.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.085834 13628 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 1 FOLLOWER]: Leader election won for term 1
23:49:22.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.105847 13628 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [term 1 LEADER]: Becoming Leader. State: Replica: 5c199b111a984b178c4429a4bfbee97a, State: Running, Role: LEADER
23:49:22.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.106730 13628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } }
23:49:22.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.111280 13664 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:22.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.111747 13664 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:22.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.116206 13666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c199b111a984b178c4429a4bfbee97a. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.116608 13666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: This master's current role is: LEADER
23:49:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.127597 13668 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:49:22.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.129787 13668 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:49:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.143875 13520 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [term 1 FOLLOWER]: Refusing update from remote peer 5c199b111a984b178c4429a4bfbee97a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:22.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:22.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.145587 13666 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:22.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.154109 13449 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [term 1 FOLLOWER]: Refusing update from remote peer 5c199b111a984b178c4429a4bfbee97a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:22.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.155565 13666 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:22.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.175294 13653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c199b111a984b178c4429a4bfbee97a. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.175592 13653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: This master's current role is: FOLLOWER
23:49:22.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.181144 13669 mvcc.cc:204] Tried to move back new op lower bound from 7305085592127295488 to 7305085591997173760. Current Snapshot: MvccSnapshot[applied={T|T < 7305085592127295488}]
23:49:22.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.182121 13670 mvcc.cc:204] Tried to move back new op lower bound from 7305085592127295488 to 7305085591997173760. Current Snapshot: MvccSnapshot[applied={T|T < 7305085592127295488}]
23:49:22.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.182086 13628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.182375 13628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: This master's current role is: LEADER
23:49:22.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.185339 13668 catalog_manager.cc:1382] Generated new cluster ID: 1f907e0b3922488ca21cd06cd6910898
23:49:22.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.185468 13668 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:49:22.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.195750 13653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.196023 13653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419 [sys.catalog]: This master's current role is: FOLLOWER
23:49:22.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.197149 13626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c199b111a984b178c4429a4bfbee97a. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.197431 13626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: This master's current role is: FOLLOWER
23:49:22.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.200366 13666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.200649 13666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a [sys.catalog]: This master's current role is: LEADER
23:49:22.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.208298 13626 sys_catalog.cc:455] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c199b111a984b178c4429a4bfbee97a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a417bc9c09be44ddbc2eab679f648128" member_type: VOTER last_known_addr { host: "127.13.20.62" port: 35095 } } peers { permanent_uuid: "50ffa6f2e4b049d38574db4eedd3e419" member_type: VOTER last_known_addr { host: "127.13.20.61" port: 45687 } } peers { permanent_uuid: "5c199b111a984b178c4429a4bfbee97a" member_type: VOTER last_known_addr { host: "127.13.20.60" port: 44081 } } }
23:49:22.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.208585 13626 sys_catalog.cc:458] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128 [sys.catalog]: This master's current role is: FOLLOWER
23:49:22.215 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:22.216 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:22.216 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:22.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:22.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:22.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:22.218 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:22.218 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:22.218 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:22.218 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:22.218 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:22.218 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:22.218 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:22.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.239369 13668 catalog_manager.cc:1405] Generated new certificate authority record
23:49:22.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.241933 13668 catalog_manager.cc:1539] Loading token signing keys...
23:49:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.269737 13668 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 5c199b111a984b178c4429a4bfbee97a: Generated new TSK 0
23:49:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.271226 13668 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.280926 13392 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/logs
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data/info.pb
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.1:0
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.20.1
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.1
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:22.287 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:22.288 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:22.288 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:22.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:22.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:22.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:22.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:22.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:22.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:22.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:22.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:22.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:22.289 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:22.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:22.388 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468162388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:22.397 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:22.398 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
23:49:22.511 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:22.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468162557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:22.566 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:22.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
23:49:22.627 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:22.628 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:22.628 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:22.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:22.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:22.628 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:22.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:22.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:22.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:22.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:22.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:22.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:22.629 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:22.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:22.696 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:22.696 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:22.697 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:22.697 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:22.697 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:22.697 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:22.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:22.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:22.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:22.698 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:22.698 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:22.698 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:22.699 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:22.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:22.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.848251 13677 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:22.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.848670 13677 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:22.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.848822 13677 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.859251 13677 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.859526 13677 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.20.1
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.872936 13677 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.1:0
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data/info.pb
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.1
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.20.1
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/logs
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:22.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:22.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:22.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:22.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:22.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:22.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:22.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.875207 13677 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:22.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.877535 13677 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:22.888 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468162888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:22.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.889710 13684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:22.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.889668 13683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:22.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:22.895627 13686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:22.898 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:22.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
23:49:22.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.900190 13677 server_base.cc:1061] running on GCE node
23:49:22.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.901098 13677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:22.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.902397 13677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:22.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.903674 13677 hybrid_clock.cc:648] HybridClock initialized: now 1783468162903599 us; error 64 us; skew 500 ppm
23:49:22.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.904212 13677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:22.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.907123 13677 webserver.cc:534] Webserver started at http://127.13.20.1:35207/ using document root <none> and password file <none>
23:49:22.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.908205 13677 fs_manager.cc:362] Metadata directory not provided
23:49:22.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.908377 13677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:22.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.908812 13677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:22.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.912117 13677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data/instance:
23:49:22.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a1a509248df44364b082f3958d577ee7"
23:49:22.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:22 on dist-test-slave-hfsf"
23:49:22.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.912956 13677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal/instance:
23:49:22.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a1a509248df44364b082f3958d577ee7"
23:49:22.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:22 on dist-test-slave-hfsf"
23:49:22.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.918190 13639 catalog_manager.cc:1294] Loaded cluster ID: 1f907e0b3922488ca21cd06cd6910898
23:49:22.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.918308 13639 catalog_manager.cc:1587] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: loading cluster ID for follower catalog manager: success
23:49:22.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.919884 13677 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
23:49:22.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.921481 13639 catalog_manager.cc:1609] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: acquiring CA information for follower catalog manager: success
23:49:22.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.923731 13639 catalog_manager.cc:1637] T 00000000000000000000000000000000 P a417bc9c09be44ddbc2eab679f648128: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:22.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.924176 13692 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:22.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.925671 13677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
23:49:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.925885 13677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal
23:49:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a1a509248df44364b082f3958d577ee7"
23:49:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:22 on dist-test-slave-hfsf"
23:49:22.926 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.926151 13677 fs_report.cc:389] FS layout report
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal
23:49:22.926 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data/data
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:22.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:22.927 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:22.927 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:22.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:22.927 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:22.927 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:22.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:22.928 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:22.928 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:22.928 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:22.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:22.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:22.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:22.928 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:22.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:22.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:22.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.949878 13677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:22.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.951031 13677 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:22.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.951367 13677 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.952538 13677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:22.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.954675 13677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:22.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.954800 13677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:22.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.954936 13677 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:22.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.955061 13677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:22.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.994285 13677 rpc_server.cc:307] RPC server started. Bound to: 127.13.20.1:46877
23:49:22.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.994393 13804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.20.1:46877 every 8 connection(s)
23:49:22.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.996163 13677 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/data/info.pb
23:49:23.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.998037 13392 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 13677
23:49:23.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:22.998279 13392 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-0/wal/instance
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.003409 13392 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/logs
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data/info.pb
23:49:23.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.2:0
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.20.2
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.2
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:23.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:23.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.029035 13807 heartbeater.cc:344] Connected to a master server at 127.13.20.61:45687
23:49:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.029505 13807 heartbeater.cc:461] Registering TS with master...
23:49:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.030836 13807 heartbeater.cc:507] Master 127.13.20.61:45687 requested a full tablet report, sending...
23:49:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.031446 13805 heartbeater.cc:344] Connected to a master server at 127.13.20.60:44081
23:49:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.031610 13805 heartbeater.cc:461] Registering TS with master...
23:49:23.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.032210 13805 heartbeater.cc:507] Master 127.13.20.60:44081 requested a full tablet report, sending...
23:49:23.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.033802 13510 ts_manager.cc:194] Registered new tserver with Master: a1a509248df44364b082f3958d577ee7 (127.13.20.1:46877)
23:49:23.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.035806 13582 ts_manager.cc:194] Registered new tserver with Master: a1a509248df44364b082f3958d577ee7 (127.13.20.1:46877)
23:49:23.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.036926 13806 heartbeater.cc:344] Connected to a master server at 127.13.20.62:35095
23:49:23.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.037096 13806 heartbeater.cc:461] Registering TS with master...
23:49:23.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.037643 13806 heartbeater.cc:507] Master 127.13.20.62:35095 requested a full tablet report, sending...
23:49:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.037941 13582 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.20.1:36205
23:49:23.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.039513 13438 ts_manager.cc:194] Registered new tserver with Master: a1a509248df44364b082f3958d577ee7 (127.13.20.1:46877)
23:49:23.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468163057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:23.066 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:23.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
23:49:23.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.114428 13664 catalog_manager.cc:1294] Loaded cluster ID: 1f907e0b3922488ca21cd06cd6910898
23:49:23.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.114560 13664 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: loading cluster ID for follower catalog manager: success
23:49:23.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.118301 13664 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: acquiring CA information for follower catalog manager: success
23:49:23.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.120911 13664 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 50ffa6f2e4b049d38574db4eedd3e419: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:23.141 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:23.141 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:23.142 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:23.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:23.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:23.142 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:23.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:23.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:23.142 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:23.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:23.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:23.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:23.142 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:23.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:23.148 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:23.148 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:23.148 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:23.148 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.148 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.148 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.148 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.149 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.149 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.149 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:23.194 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:23.194 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:23.195 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:23.195 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:23.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:23.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:23.195 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:23.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:23.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:23.195 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:23.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:23.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:23.195 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:23.248 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:23.248 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:23.248 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:23.248 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:23.249 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:23.249 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:23.249 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:23.249 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:23.249 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:23.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:23.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:23.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:23.249 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:23.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:23.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468163388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:23.397 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:23.398 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
23:49:23.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.418428 13815 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:23.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.418848 13815 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:23.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.418996 13815 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:23.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.429170 13815 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:23.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.429441 13815 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.20.2
23:49:23.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.441555 13815 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:23.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:23.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.2:0
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data/info.pb
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.2
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.20.2
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/logs
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:23.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:23.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.443719 13815 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:23.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.445868 13815 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:23.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.461244 13821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:23.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.461282 13820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:23.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:23.461740 13823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:23.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.462787 13815 server_base.cc:1061] running on GCE node
23:49:23.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.463565 13815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:23.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.464694 13815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:23.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.465951 13815 hybrid_clock.cc:648] HybridClock initialized: now 1783468163465877 us; error 62 us; skew 500 ppm
23:49:23.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.466341 13815 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:23.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.469313 13815 webserver.cc:534] Webserver started at http://127.13.20.2:46153/ using document root <none> and password file <none>
23:49:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.470211 13815 fs_manager.cc:362] Metadata directory not provided
23:49:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.470359 13815 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.470741 13815 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.473596 13815 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data/instance:
23:49:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e870894e7d424a0b9e3746c78d9e0156"
23:49:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:23 on dist-test-slave-hfsf"
23:49:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.474524 13815 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal/instance:
23:49:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e870894e7d424a0b9e3746c78d9e0156"
23:49:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:23 on dist-test-slave-hfsf"
23:49:23.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.481009 13815 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.000s
23:49:23.483 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.483 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.483 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.484 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.485 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27221), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [147ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [154ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [155ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [238ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [239ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [246ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [246ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [270ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [271ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [273ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [283ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [283ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [303ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [345ms] refreshing cache from master, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [349ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [349ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [405ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [405ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [423ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [683ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [783ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [783ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1084ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [2980ms] refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [2981ms] too many traces: truncated at 100 traces, [2981ms] too many traces: truncated at 100 traces, deferred=Deferred@198561606(state=PENDING, result=null, callback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290), errback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290)))
23:49:23.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.485595 13829 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:23.485 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.486 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.486 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.486 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27221), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [147ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [154ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [155ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [238ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [239ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [246ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [246ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [270ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [271ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [273ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [283ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [283ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [303ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [345ms] refreshing cache from master, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [349ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [349ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [405ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [405ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [423ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [683ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [783ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [783ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1084ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [2980ms] refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [2981ms] too many traces: truncated at 100 traces, [2981ms] too many traces: truncated at 100 traces, deferred=Deferred@198561606(state=PENDING, result=null, callback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290), errback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27221), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [147ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [154ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [155ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [238ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [239ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [246ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [246ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [270ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [271ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [273ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [283ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [283ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [303ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [345ms] refreshing cache from master, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [349ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [349ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [405ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [405ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [423ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [683ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [783ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [783ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1084ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [2980ms] refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [2981ms] too many traces: truncated at 100 traces, [2981ms] too many traces: truncated at 100 traces, deferred=Deferred@198561606(state=PENDING, result=null, callback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290), errback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.195.125:41211
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:23.486 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.486 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.486 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.486 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.486 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.486 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.487 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.487 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.487 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.487 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.489166 13815 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
23:49:23.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.489538 13815 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal
23:49:23.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e870894e7d424a0b9e3746c78d9e0156"
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:23 on dist-test-slave-hfsf"
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.489941 13815 fs_report.cc:389] FS layout report
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data/data
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:23.491 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27221), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [147ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [154ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [155ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [238ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [239ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [246ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [246ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [270ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [271ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [273ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [283ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [283ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [303ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [345ms] refreshing cache from master, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [349ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [349ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [405ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [405ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [423ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [683ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [783ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [783ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1084ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [2980ms] refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [2981ms] too many traces: truncated at 100 traces, [2981ms] too many traces: truncated at 100 traces, deferred=Deferred@198561606(state=PENDING, result=null, callback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290), errback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27221), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [47ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [147ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [154ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [155ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [238ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [239ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [246ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [246ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [270ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [271ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [272ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [273ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [282ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [283ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [283ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [303ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [303ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [345ms] refreshing cache from master, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [348ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [349ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [349ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [404ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [405ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [405ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [423ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [682ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [683ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [782ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [783ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [783ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1084ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.124:40929: Network error: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.126:36941: Network error: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.5.195.125:41211: Network error: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [1425ms] delaying RPC due to: Service unavailable: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211, [2980ms] refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.124:40929, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.126:36941, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.195.125:41211, [2981ms] too many traces: truncated at 100 traces, [2981ms] too many traces: truncated at 100 traces, deferred=Deferred@198561606(state=PENDING, result=null, callback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290), errback=(continuation of Deferred@451713222 after retry RPC after error@1405356283) -> (continuation of Deferred@267783714 after retry RPC after error@712789861) -> (continuation of Deferred@1420351556 after retry RPC after error@660111866) -> (continuation of Deferred@417340461 after retry RPC after error@1353678643) -> (continuation of Deferred@1121445786 after retry RPC after error@560195947) -> (continuation of Deferred@964331550 after retry RPC after error@302460645) -> (continuation of Deferred@1863442440 after retry RPC after error@1367831600) -> (continuation of Deferred@1020275814 after retry RPC after error@386616607) -> (continuation of Deferred@2012937814 after retry RPC after error@490091117) -> (continuation of Deferred@548970161 after retry RPC after error@1838566412) -> (continuation of Deferred@1304299430 after retry RPC after error@1639444774) -> (continuation of Deferred@85898935 after retry RPC after error@1513581620) -> (continuation of Deferred@1728693219 after retry RPC after error@963195109) -> (continuation of Deferred@1228051057 after retry RPC after error@671420847) -> (continuation of Deferred@20629911 after retry RPC after error@1906585421) -> (continuation of Deferred@744000018 after retry RPC after error@743472735) -> (continuation of Deferred@2071034931 after retry RPC after error@729803351) -> (continuation of Deferred@1126165808 after retry RPC after error@1813172618) -> (continuation of Deferred@477276383 after retry RPC after error@1208730708) -> (continuation of Deferred@1950467592 after retry RPC after error@237356939) -> (continuation of Deferred@119055040 after retry RPC after error@296218387) -> (continuation of Deferred@1798048425 after retry RPC after error@1259700696) -> (continuation of Deferred@165225688 after retry RPC after error@665361799) -> (continuation of Deferred@752525977 after retry RPC after error@1260846491) -> (continuation of Deferred@194641859 after retry RPC after error@1757286290)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.195.125:41211
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:23.492 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
23:49:23.492 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b15b774f375318429e8c166741c1d9d) switched from state RUNNING to RESTARTING.
23:49:23.492 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
23:49:23.492 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
23:49:23.493 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
23:49:23.493 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
23:49:23.493 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
23:49:23.493 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
23:49:23.493 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
23:49:23.493 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
23:49:23.493 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
23:49:23.494 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
23:49:23.494 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
23:49:23.499 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
23:49:23.499 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:23.499 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
23:49:23.499 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
23:49:23.500 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
23:49:23.500 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
23:49:23.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:23.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
23:49:23.501 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
23:49:23.503 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.503 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.503 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.504 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.504 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.504 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.504 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.504 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.504 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.504 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.508 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
23:49:23.508 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
23:49:23.508 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
23:49:23.509 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:23.509 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
23:49:23.509 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
23:49:23.515 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
23:49:23.516 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
23:49:23.516 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
23:49:23.519 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
23:49:23.519 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
23:49:23.520 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
23:49:23.520 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
23:49:23.520 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
23:49:23.520 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
23:49:23.520 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
23:49:23.520 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
23:49:23.521 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:23.521 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
23:49:23.522 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
23:49:23.522 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
23:49:23.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.522511 13815 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:23.523 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.523 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:23.523 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.523 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:23.523 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.523811 13815 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:23.524 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b15b774f375318429e8c166741c1d9d
23:49:23.524 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.524 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.524355 13815 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:23.524 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.524 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.524 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.525 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.525 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.525 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.525 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.525 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.526168 13815 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:23.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.528436 13815 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:23.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.528570 13815 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:23.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.528685 13815 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:23.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.528800 13815 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:23.543 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.543 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.544 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.544 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.544 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.545 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.545 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.545 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.545 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.545 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468163557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:23.563 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.564 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.564 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.565 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.565 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.565 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.565 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.565 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.569 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:49:23.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
23:49:23.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.587795 13815 rpc_server.cc:307] RPC server started. Bound to: 127.13.20.2:33087
23:49:23.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.587908 13954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.20.2:33087 every 8 connection(s)
23:49:23.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.590175 13815 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/data/info.pb
23:49:23.596 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (bbc34d76ac15add629743db00c4f4a33) switched from state RESTARTING to RUNNING.
23:49:23.596 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job bbc34d76ac15add629743db00c4f4a33 from Checkpoint 66 @ 1783468100667 for bbc34d76ac15add629743db00c4f4a33 located at file:/tmp/junit16513366076383754312/checkpoints/bbc34d76ac15add629743db00c4f4a33/chk-66.
23:49:23.597 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
23:49:23.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 66 for source Source: KuduSource to checkpoint.
23:49:23.597 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
23:49:23.598 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job bbc34d76ac15add629743db00c4f4a33: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:23.599 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
23:49:23.599 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to da593351-5360-4df4-b8eb-178268a89f7c @ 127.0.0.1 (dataPort=-1) with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758
23:49:23.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.597566 13392 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 13815
23:49:23.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.597859 13392 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-1/wal/instance
23:49:23.600 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:49:23.603 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.603 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.603 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.604243 13392 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/logs
23:49:23.604 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.604 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.605 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.605 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data/info.pb
23:49:23.606 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.3:0
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.20.3
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.3
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:23.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:23.612 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:23.613 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:23.613 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:23.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:23.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:23.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:23.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:23.614 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:23.614 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:23.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:23.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:23.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:23.614 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:23.615 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 6b51d7ad62a6e78a6dc9bd0d754a4758.
23:49:23.617 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
23:49:23.618 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
23:49:23.619 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@562191ba
23:49:23.619 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:23.619 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16513366076383754312/checkpoints")
23:49:23.619 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
23:49:23.620 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bb540fbba10c0880a91d0f440f653aae_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
23:49:23.622 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3500435c
23:49:23.625 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:23.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.638603 13955 heartbeater.cc:344] Connected to a master server at 127.13.20.60:44081
23:49:23.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.639140 13955 heartbeater.cc:461] Registering TS with master...
23:49:23.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.640471 13955 heartbeater.cc:507] Master 127.13.20.60:44081 requested a full tablet report, sending...
23:49:23.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.642493 13582 ts_manager.cc:194] Registered new tserver with Master: e870894e7d424a0b9e3746c78d9e0156 (127.13.20.2:33087)
23:49:23.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.643630 13582 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.20.2:60509
23:49:23.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.654325 13956 heartbeater.cc:344] Connected to a master server at 127.13.20.62:35095
23:49:23.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.654536 13956 heartbeater.cc:461] Registering TS with master...
23:49:23.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.655295 13956 heartbeater.cc:507] Master 127.13.20.62:35095 requested a full tablet report, sending...
23:49:23.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.656803 13438 ts_manager.cc:194] Registered new tserver with Master: e870894e7d424a0b9e3746c78d9e0156 (127.13.20.2:33087)
23:49:23.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.658311 13957 heartbeater.cc:344] Connected to a master server at 127.13.20.61:45687
23:49:23.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.658502 13957 heartbeater.cc:461] Registering TS with master...
23:49:23.658 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.658885 13957 heartbeater.cc:507] Master 127.13.20.61:45687 requested a full tablet report, sending...
23:49:23.659 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:23.660313 13510 ts_manager.cc:194] Registered new tserver with Master: e870894e7d424a0b9e3746c78d9e0156 (127.13.20.2:33087)
23:49:23.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.661 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.663 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.663 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.678 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.679 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.680 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.680 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.680 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.680 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.681 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.681 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.681 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.681 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.683 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.683 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.683 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.684 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.684 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.684 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.684 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.684 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.684 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.684 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.698 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.699 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.699 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.700 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.700 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.700 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.700 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.701 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.716 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:23.717 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:23.717 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:23.717 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.717 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.717 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.717 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.717 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:23.718 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.718 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.719 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.719 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.719 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.719 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.719 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.719 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.719 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.719 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.719 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.719 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.738 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.738 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.739 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.739 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.739 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.739 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.739 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.739 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.739 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.739 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.739 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.739 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.739 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.758 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.759 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.759 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.759 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.759 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.759 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.759 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.759 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.760 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.760 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.823 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:23.823 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:23.824 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:23.824 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.824 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:23.824 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:23.824 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.824 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.824 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:23.824 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:23.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:23.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:23.835 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:23.835 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:23.836 [DEBUG - pool-206-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:23.836 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.836 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.836 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:23.836 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.836 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.836 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.836 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.836 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:23.836 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:23.836 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:23.837 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27507), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [58ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [62ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [74ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [74ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [89ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [94ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [101ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [102ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [152ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [156ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [159ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [159ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [182ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [182ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [182ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [183ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [202ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [202ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [203ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [203ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [242ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [242ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [242ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [242ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [302ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [443ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [444ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [444ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [444ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [502ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [504ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [505ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [505ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [762ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [763ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [764ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [764ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1540ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1543ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [1543ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [2622ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [2622ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [2622ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [2622ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [5161ms] refreshing cache from master, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [5162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [5162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [5162ms] too many traces: truncated at 100 traces, deferred=Deferred@1250033637(state=PENDING, result=null, callback=(continuation of Deferred@1965246146 after retry RPC after error@1304385558) -> (continuation of Deferred@1319457866 after retry RPC after error@194962604) -> (continuation of Deferred@1692710475 after retry RPC after error@1403796777) -> (continuation of Deferred@927933458 after retry RPC after error@1267211731) -> (continuation of Deferred@169847815 after retry RPC after error@954764568) -> (continuation of Deferred@1992905123 after retry RPC after error@2107948076) -> (continuation of Deferred@179066891 after retry RPC after error@1984992267) -> (continuation of Deferred@1244174123 after retry RPC after error@305465246) -> (continuation of Deferred@2050058707 after retry RPC after error@137583186) -> (continuation of Deferred@111941040 after retry RPC after error@1008728844) -> (continuation of Deferred@1301377709 after retry RPC after error@1600274567) -> (continuation of Deferred@965070670 after retry RPC after error@2055312617) -> (continuation of Deferred@1019450638 after retry RPC after error@1902681193) -> (continuation of Deferred@1719718581 after retry RPC after error@273687632) -> (continuation of Deferred@815511729 after retry RPC after error@86368543) -> (continuation of Deferred@1699778164 after retry RPC after error@1949520938) -> (continuation of Deferred@427832365 after retry RPC after error@864490267) -> (continuation of Deferred@1380255793 after retry RPC after error@1010406487) -> (continuation of Deferred@612433569 after retry RPC after error@789851873) -> (continuation of Deferred@1433059250 after retry RPC after error@629215844) -> (continuation of Deferred@114787715 after retry RPC after error@146460830), errback=(continuation of Deferred@1965246146 after retry RPC after error@1304385558) -> (continuation of Deferred@1319457866 after retry RPC after error@194962604) -> (continuation of Deferred@1692710475 after retry RPC after error@1403796777) -> (continuation of Deferred@927933458 after retry RPC after error@1267211731) -> (continuation of Deferred@169847815 after retry RPC after error@954764568) -> (continuation of Deferred@1992905123 after retry RPC after error@2107948076) -> (continuation of Deferred@179066891 after retry RPC after error@1984992267) -> (continuation of Deferred@1244174123 after retry RPC after error@305465246) -> (continuation of Deferred@2050058707 after retry RPC after error@137583186) -> (continuation of Deferred@111941040 after retry RPC after error@1008728844) -> (continuation of Deferred@1301377709 after retry RPC after error@1600274567) -> (continuation of Deferred@965070670 after retry RPC after error@2055312617) -> (continuation of Deferred@1019450638 after retry RPC after error@1902681193) -> (continuation of Deferred@1719718581 after retry RPC after error@273687632) -> (continuation of Deferred@815511729 after retry RPC after error@86368543) -> (continuation of Deferred@1699778164 after retry RPC after error@1949520938) -> (continuation of Deferred@427832365 after retry RPC after error@864490267) -> (continuation of Deferred@1380255793 after retry RPC after error@1010406487) -> (continuation of Deferred@612433569 after retry RPC after error@789851873) -> (continuation of Deferred@1433059250 after retry RPC after error@629215844) -> (continuation of Deferred@114787715 after retry RPC after error@146460830)))
23:49:23.839 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.839 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.839 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.839 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.840 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.840 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.840 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.840 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.840 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.840 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.840 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.858 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:23.858 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:23.859 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:23.859 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.859 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.859 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.859 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:23.859 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:23.860 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.860 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:23.860 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:23.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468163888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:23.898 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:23.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
23:49:23.907 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:23.907 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:23.907 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:23.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:23.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:23.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:23.908 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:23.908 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:23.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:23.908 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:23.908 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:23.908 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:23.908 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:24.023 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:24.024 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:24.024 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:24.024 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.024 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.024 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.024 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.024 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.024 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.024 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.024 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.024 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:24.036 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:24.036 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:24.036 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:24.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:24.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:24.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:24.037 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:24.037 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:24.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:24.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:24.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:24.038 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:24.038 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:24.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.042183 13805 heartbeater.cc:499] Master 127.13.20.60:44081 was elected leader, sending a full tablet report...
23:49:24.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.056267 13964 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:24.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.056612 13964 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:24.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.056705 13964 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:24.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468164057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:24.066 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:24.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
23:49:24.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.069099 13964 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:24.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.069283 13964 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.20.3
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.081458 13964 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.20.20:33331
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.20.3:0
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:24.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data/info.pb
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.20.3
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.20.62:35095,127.13.20.61:45687,127.13.20.60:44081
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.20.3
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/logs
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:24.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.083575 13964 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:24.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.085783 13964 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.098412 13981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.098687 13984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:24.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:24.100627 13982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:24.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.101152 13964 server_base.cc:1061] running on GCE node
23:49:24.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.101845 13964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:24.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.103075 13964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:24.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.104341 13964 hybrid_clock.cc:648] HybridClock initialized: now 1783468164104287 us; error 46 us; skew 500 ppm
23:49:24.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.104717 13964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:24.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.107357 13964 webserver.cc:534] Webserver started at http://127.13.20.3:44419/ using document root <none> and password file <none>
23:49:24.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.108271 13964 fs_manager.cc:362] Metadata directory not provided
23:49:24.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.108381 13964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:24.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.108693 13964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:24.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.111496 13964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data/instance:
23:49:24.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4"
23:49:24.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:24 on dist-test-slave-hfsf"
23:49:24.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.112337 13964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal/instance:
23:49:24.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4"
23:49:24.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:24 on dist-test-slave-hfsf"
23:49:24.118 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:24.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.118678 13964 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
23:49:24.119 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:24.119 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:24.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.120 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.120 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:24.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.123685 13990 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:24.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.125259 13964 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:49:24.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.125480 13964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal
23:49:24.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4"
23:49:24.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:24 on dist-test-slave-hfsf"
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.125730 13964 fs_report.cc:389] FS layout report
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data/data
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:24.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.140167 13964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:24.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.141166 13964 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:24.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.141508 13964 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:24.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.142670 13964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:24.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:24.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.145026 13964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:24.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.145174 13964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:24.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.145288 13964 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:24.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.145373 13964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:24.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.183903 13964 rpc_server.cc:307] RPC server started. Bound to: 127.13.20.3:43797
23:49:24.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.184022 14103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.20.3:43797 every 8 connection(s)
23:49:24.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.185638 13964 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/data/info.pb
23:49:24.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.195168 13392 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 13964
23:49:24.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.195398 13392 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster16602063331274989071/ts-2/wal/instance
23:49:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.221065 14104 heartbeater.cc:344] Connected to a master server at 127.13.20.60:44081
23:49:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.221743 14104 heartbeater.cc:461] Registering TS with master...
23:49:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.221930 14106 heartbeater.cc:344] Connected to a master server at 127.13.20.61:45687
23:49:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.222158 14106 heartbeater.cc:461] Registering TS with master...
23:49:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.223321 14105 heartbeater.cc:344] Connected to a master server at 127.13.20.62:35095
23:49:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.223448 14106 heartbeater.cc:507] Master 127.13.20.61:45687 requested a full tablet report, sending...
23:49:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.223497 14105 heartbeater.cc:461] Registering TS with master...
23:49:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.223723 14104 heartbeater.cc:507] Master 127.13.20.60:44081 requested a full tablet report, sending...
23:49:24.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.224144 14105 heartbeater.cc:507] Master 127.13.20.62:35095 requested a full tablet report, sending...
23:49:24.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.225613 13582 ts_manager.cc:194] Registered new tserver with Master: 2f8ef3cb80cd4033b631ffe32cdb0ee4 (127.13.20.3:43797)
23:49:24.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.225734 13510 ts_manager.cc:194] Registered new tserver with Master: 2f8ef3cb80cd4033b631ffe32cdb0ee4 (127.13.20.3:43797)
23:49:24.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.225733 13438 ts_manager.cc:194] Registered new tserver with Master: 2f8ef3cb80cd4033b631ffe32cdb0ee4 (127.13.20.3:43797)
23:49:24.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.226835 13582 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.20.3:57137
23:49:24.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.235496 13392 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:49:24.237 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:24.237 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:49:24.239 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.20.62"
      port: 35095
    }
    bound_http_address {
      host: "127.13.20.62"
      port: 36059
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.20.61"
      port: 45687
    }
    bound_http_address {
      host: "127.13.20.61"
      port: 41575
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.20.60"
      port: 44081
    }
    bound_http_address {
      host: "127.13.20.60"
      port: 36105
    }
  }
}

23:49:24.239 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:49:24.240 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.20.1"
      port: 46877
    }
    bound_http_address {
      host: "127.13.20.1"
      port: 35207
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.20.2"
      port: 33087
    }
    bound_http_address {
      host: "127.13.20.2"
      port: 46153
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.20.3"
      port: 43797
    }
    bound_http_address {
      host: "127.13.20.3"
      port: 44419
    }
  }
}

23:49:24.240 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:49:24.241 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:24.242 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:49:24.242 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZ1k3RW/test-tmp
23:49:24.242 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
23:49:24.242 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZ1k3RW/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
23:49:24.247 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:49:24.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:24.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:24.363 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:24.363 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:24.364 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:24.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.364 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.364 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.364 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.364 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:24.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468164388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:24.398 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:24.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
23:49:24.403 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:24.404 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:24.404 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:24.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:24.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:24.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:24.404 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:24.411 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:24.412 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:24.412 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:24.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:24.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:24.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:24.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:24.412 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:24.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:24.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:24.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:24.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:24.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:24.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468164557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:24.566 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:24.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
23:49:24.579 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:24.579 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:24.579 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:24.579 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.579 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.580 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.580 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.580 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.580 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:24.616 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:24.616 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:24.616 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:24.616 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:24.616 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:24.616 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:24.616 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:24.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:24.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:24.617 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:24.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:24.617 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:24.617 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:24.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.648257 13955 heartbeater.cc:499] Master 127.13.20.60:44081 was elected leader, sending a full tablet report...
23:49:24.653 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:24.653 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:49:24.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.656184 14114 mini_oidc.cc:150] Starting JWKS server
23:49:24.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.658882 14114 webserver.cc:534] Webserver started at http://127.0.0.1:34261/ using document root <none> and password file <none>
23:49:24.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.659231 14114 mini_oidc.cc:186] Starting OIDC Discovery server
23:49:24.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.659978 14114 webserver.cc:534] Webserver started at http://127.0.0.1:41355/ using document root <none> and password file <none>
23:49:24.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:24Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:49:24.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:24Z Disabled control of system clock
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:24.695963 14114 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/logs
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data/info.pb
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.190:46423
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.190
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:24.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34261/jwks.json with env {}
23:49:24.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:24.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:24.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468164888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:24.898 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:24.899 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:24.899 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:24.899 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:24.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
23:49:24.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:24.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:24.900 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.900 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:24.900 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:25.055 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:25.055 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:25.055 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:25.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.055 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.056 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.056 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.056 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.056 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.056 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:25.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468165057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:25.066 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:25.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
23:49:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.117213 14125 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.117676 14125 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.117794 14125 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:25.130 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b15b774f375318429e8c166741c1d9d) switched from state RESTARTING to RUNNING.
23:49:25.130 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 6b15b774f375318429e8c166741c1d9d from Checkpoint 67 @ 1783468134902 for 6b15b774f375318429e8c166741c1d9d located at file:/tmp/junit15317314641945509700/checkpoints/6b15b774f375318429e8c166741c1d9d/chk-67.
23:49:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.131160 14125 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.131299 14125 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:25.131 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
23:49:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.131389 14125 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.131448 14125 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.131524 14125 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.131582 14125 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34261/jwks.json
23:49:25.131 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
23:49:25.132 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
23:49:25.133 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
23:49:25.133 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id a857b45a30f1252b1fcc0c16c9bf115a
23:49:25.134 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:25.134 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
23:49:25.134 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:25.134 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:25.134 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
23:49:25.135 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 532cad1ce9bc484a8df8730b4379ae15
23:49:25.135 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot a857b45a30f1252b1fcc0c16c9bf115a.
23:49:25.135 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:25.135 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.135 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.135 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:25.136 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.136 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.136 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.136 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id a857b45a30f1252b1fcc0c16c9bf115a.
23:49:25.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.136 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
23:49:25.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.136 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:25.137 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:25.137 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
23:49:25.137 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 7b1f70b00c2a8ee4ccf39cae7c72c607
23:49:25.137 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
23:49:25.137 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 532cad1ce9bc484a8df8730b4379ae15.
23:49:25.137 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
23:49:25.138 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
23:49:25.138 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b15b774f375318429e8c166741c1d9d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:25.138 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48ffae02
23:49:25.138 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:25.138 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
23:49:25.138 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c95b8a24-c846-4917-9363-7149c0489232 @ 127.0.0.1 (dataPort=-1) with allocation id 689d84fe30510664cb4c992d23e6dc0a
23:49:25.138 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 532cad1ce9bc484a8df8730b4379ae15.
23:49:25.138 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:49:25.139 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
23:49:25.139 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
23:49:25.139 [INFO - Thread-52] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
23:49:25.139 [DEBUG - Thread-52] (Connection.java:575) [peer master-127.5.195.124:40929(127.5.195.124:40929)] disconnecting while in state TERMINATED
23:49:25.140 [DEBUG - Thread-52] (Connection.java:575) [peer master-127.5.195.126:36941(127.5.195.126:36941)] disconnecting while in state TERMINATED
23:49:25.140 [DEBUG - Thread-52] (Connection.java:575) [peer master-127.5.195.125:41211(127.5.195.125:41211)] disconnecting while in state TERMINATED
23:49:25.140 [DEBUG - Thread-52] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:25.141 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61c9dcfb
23:49:25.142 [INFO - Thread-52] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
23:49:25.142 [INFO - Thread-52] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
23:49:25.143 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:25.144 [DEBUG - Thread-52] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:25.144 [INFO - Thread-52] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:49:25.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.147 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:49:25.147 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
23:49:25.147 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
23:49:25.148 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5012c30e
23:49:25.148 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:25.148 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:49:25.148 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 7b1f70b00c2a8ee4ccf39cae7c72c607.
23:49:25.148 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
23:49:25.149 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.148268 14125 master_runner.cc:387] Master server non-default flags:
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.190:46423
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34261/jwks.json
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data/info.pb
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.190
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:25.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/logs
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:25.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.150560 14125 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:25.151 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4583c8c3
23:49:25.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.153223 14125 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:25.154 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:25.155 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.156 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:25.156 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:25.156 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:25.156 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:25.156 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 689d84fe30510664cb4c992d23e6dc0a.
23:49:25.157 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.157 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 689d84fe30510664cb4c992d23e6dc0a.
23:49:25.158 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.158 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.160 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
23:49:25.160 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
23:49:25.161 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c0e95
23:49:25.161 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:25.161 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:49:25.162 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
23:49:25.162 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
23:49:25.165 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d55970c
23:49:25.165 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
23:49:25.165 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
23:49:25.166 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60a3bbc4
23:49:25.166 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:25.166 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit15317314641945509700/checkpoints")
23:49:25.166 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
23:49:25.166 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (960d4d7fbe7ff7977bf98ecf6e7e1f7a_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
23:49:25.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.170583 14141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:25.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.170653 14143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:25.171 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61db555b
23:49:25.173 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:25.174 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:25.174 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.176 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.176 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.176 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.177 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.178 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.178 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.178 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.179 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.179 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.179 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.180 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.180 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.181 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.181 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.181 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.181 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.183174 14125 server_base.cc:1061] running on GCE node
23:49:25.183 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.184 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.184 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.185 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.185626 14146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:25.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.186796 14125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:25.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.188958 14125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:25.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.190356 14125 hybrid_clock.cc:648] HybridClock initialized: now 1783468165190251 us; error 91 us; skew 500 ppm
23:49:25.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.190830 14125 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:25.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.194169 14125 webserver.cc:534] Webserver started at http://127.13.200.190:35393/ using document root <none> and password file <none>
23:49:25.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.195289 14125 fs_manager.cc:362] Metadata directory not provided
23:49:25.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.195430 14125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:25.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.195837 14125 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:25.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.196 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.198 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.199 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.199352 14125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data/instance:
23:49:25.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e6b4264c3954e6d9ddbd75ec40530ee"
23:49:25.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:25 on dist-test-slave-hfsf"
23:49:25.200 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.200595 14125 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal/instance:
23:49:25.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e6b4264c3954e6d9ddbd75ec40530ee"
23:49:25.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:25 on dist-test-slave-hfsf"
23:49:25.203 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.203 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.203 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.204 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.207 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.207 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.208 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.208 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.208873 14125 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
23:49:25.211 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.212 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.212 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.212 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.213 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.213 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.213 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.213 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.214 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.214 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.215 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.215 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.215 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.216 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.216 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.216 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.217 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.219 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.219 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.219 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.219 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.220 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.220 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.220 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.221 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.221 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.222 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.223 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.224 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.225 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.226 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.227643 14167 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:25.228 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.228 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.228 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.228 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.229 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.229470 14104 heartbeater.cc:499] Master 127.13.20.60:44081 was elected leader, sending a full tablet report...
23:49:25.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.230523 14125 fs_manager.cc:730] Time spent opening block manager: real 0.019s	user 0.014s	sys 0.003s
23:49:25.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.231 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.230999 14125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal
23:49:25.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e6b4264c3954e6d9ddbd75ec40530ee"
23:49:25.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:25 on dist-test-slave-hfsf"
23:49:25.231 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28898), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [192ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [193ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [194ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [195ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [195ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [208ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [213ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [222ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [222ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [273ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [278ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [291ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [291ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [304ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [304ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [305ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [321ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [322ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [322ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [322ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [366ms] refreshing cache from master, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [367ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [367ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [367ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [367ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [402ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [402ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [403ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [403ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [462ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [462ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [462ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [463ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [702ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [702ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [709ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [709ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [822ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [823ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [823ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [823ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1582ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [3240ms] refreshing cache from master, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [3242ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [3242ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [6961ms] refreshing cache from master, [6961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [6961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [6962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [6962ms] too many traces: truncated at 100 traces, deferred=Deferred@68399340(state=PENDING, result=null, callback=(continuation of Deferred@1938413229 after retry RPC after error@215363125) -> (continuation of Deferred@278707241 after retry RPC after error@152173062) -> (continuation of Deferred@873494839 after retry RPC after error@160062982) -> (continuation of Deferred@2080560874 after retry RPC after error@2051392166) -> (continuation of Deferred@1294718232 after retry RPC after error@369809621) -> (continuation of Deferred@2086009208 after retry RPC after error@676418726) -> (continuation of Deferred@994166689 after retry RPC after error@2068671596) -> (continuation of Deferred@671138884 after retry RPC after error@173425030) -> (continuation of Deferred@1067447202 after retry RPC after error@799131185) -> (continuation of Deferred@19731813 after retry RPC after error@969883319) -> (continuation of Deferred@2039335119 after retry RPC after error@1488718209) -> (continuation of Deferred@827570638 after retry RPC after error@1906901973) -> (continuation of Deferred@1727358623 after retry RPC after error@1589484481) -> (continuation of Deferred@1921831953 after retry RPC after error@1266861630) -> (continuation of Deferred@110002255 after retry RPC after error@887058636) -> (continuation of Deferred@552011290 after retry RPC after error@2106165006) -> (continuation of Deferred@259517448 after retry RPC after error@1088533562) -> (continuation of Deferred@1479458282 after retry RPC after error@1764683798) -> (continuation of Deferred@1493784215 after retry RPC after error@335833576) -> (continuation of Deferred@971528047 after retry RPC after error@668511748) -> (continuation of Deferred@888600966 after retry RPC after error@51023321) -> (continuation of Deferred@2023944696 after retry RPC after error@451463270), errback=(continuation of Deferred@1938413229 after retry RPC after error@215363125) -> (continuation of Deferred@278707241 after retry RPC after error@152173062) -> (continuation of Deferred@873494839 after retry RPC after error@160062982) -> (continuation of Deferred@2080560874 after retry RPC after error@2051392166) -> (continuation of Deferred@1294718232 after retry RPC after error@369809621) -> (continuation of Deferred@2086009208 after retry RPC after error@676418726) -> (continuation of Deferred@994166689 after retry RPC after error@2068671596) -> (continuation of Deferred@671138884 after retry RPC after error@173425030) -> (continuation of Deferred@1067447202 after retry RPC after error@799131185) -> (continuation of Deferred@19731813 after retry RPC after error@969883319) -> (continuation of Deferred@2039335119 after retry RPC after error@1488718209) -> (continuation of Deferred@827570638 after retry RPC after error@1906901973) -> (continuation of Deferred@1727358623 after retry RPC after error@1589484481) -> (continuation of Deferred@1921831953 after retry RPC after error@1266861630) -> (continuation of Deferred@110002255 after retry RPC after error@887058636) -> (continuation of Deferred@552011290 after retry RPC after error@2106165006) -> (continuation of Deferred@259517448 after retry RPC after error@1088533562) -> (continuation of Deferred@1479458282 after retry RPC after error@1764683798) -> (continuation of Deferred@1493784215 after retry RPC after error@335833576) -> (continuation of Deferred@971528047 after retry RPC after error@668511748) -> (continuation of Deferred@888600966 after retry RPC after error@51023321) -> (continuation of Deferred@2023944696 after retry RPC after error@451463270)))
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.231721 14125 fs_report.cc:389] FS layout report
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data/data
23:49:25.232 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:25.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:25.232 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:25.232 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.236 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.237 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.237 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.238 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.238 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.238 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.239 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.239 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.239 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.239 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.239 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.239 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.239 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.239 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.239 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.240 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.240 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.240 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.240 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.240 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.240 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.241 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.243 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.243 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.243 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.244 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.244 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.251 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.251 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.255 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.255 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.256 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.256 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.256 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.256 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.256 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.257 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.257 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.257 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.257 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.258 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.258 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.258 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.258 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.258 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.258 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.258 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.259 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.259 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.259 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.259 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.260 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.260 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.260 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.260 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.260 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.260 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.261 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.261 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.262 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.262 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.262 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.262 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.262 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.275 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.276 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.276 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.276 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.276 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.276 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.276 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.276 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.277 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.277 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.277 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.278 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.278 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.278 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.278 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.278 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.278 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.278 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.278 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.279 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.279 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.280 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.280 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.280 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.280 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.280 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.281 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.281 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.281 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.282 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.282 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.282 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.282 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.282 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.283 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.283 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.283715 14125 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:25.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.284 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.285100 14125 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:25.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.285415 14125 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:25.295 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.296 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.296 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.297 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.297 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.297 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.297 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.297 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.297 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.297 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.298 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.298 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.298 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.299 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.299 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.299 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.299 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.300 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.300 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.300 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.301 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.301 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.301 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.301 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.301 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.301 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.302 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.302 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.302 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.302 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.302 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.303 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.316 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.316 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.316 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.316 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.317 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.317 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.317 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.317 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.318 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.318 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.318 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.318 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.318 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.318 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.318 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.318 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.318 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.319 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.319 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.319 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.320 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.320 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.320 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.320 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.320 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.321 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.321 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.321 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.321 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.321 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.321 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.322 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.322 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.322 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.322 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.323 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.324 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.324 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.324 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.324 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.351243 14125 rpc_server.cc:307] RPC server started. Bound to: 127.13.200.190:46423
23:49:25.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.351277 14245 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.200.190:46423 every 8 connection(s)
23:49:25.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.353490 14125 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/data/info.pb
23:49:25.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.355944 14114 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 14125
23:49:25.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.356359 14114 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-0/wal/instance
23:49:25.360 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.360 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.360 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.361 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.361 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.361 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.362 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.362 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.362 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.363 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.364 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.365 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.365 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.365 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.365 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.365 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.365 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.365 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.366 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.366 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.366 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.366 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.360529 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:25.360 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.366 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.366 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.366 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.367 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.367 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.367 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.367 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.367 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.368 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.369194 14114 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/logs
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data/info.pb
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.189:33373
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.189
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:25.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:25.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:25.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:25.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:25.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34261/jwks.json with env {}
23:49:25.374 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:25.375 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:25.375 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:25.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.375 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.376 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.376 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.376 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.376 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.376 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.376 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.374024 14246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } has no permanent_uuid. Determining permanent_uuid...
23:49:25.377 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.378 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.378 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.379 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.379 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.380 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.380 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.380 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.381 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.381 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.381 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.381 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.381 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.381 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.382 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.382 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.382 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.382 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.382 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.382 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.383 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.383 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:25.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.383 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:25.383 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.384 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:25.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.384 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.384 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.384 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.384 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.384 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.384 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.384 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.385 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.385 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.385 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.385 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:25.388 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468165387 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:25.400 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.401 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.401 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.401 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
23:49:25.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.403 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.403 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.403 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.403 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.405 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
23:49:25.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.413998 14246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } has no permanent_uuid. Determining permanent_uuid...
23:49:25.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.415737 14186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.200.189:33373: connect: Connection refused (error 111)
23:49:25.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.417841 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.189:33373: Network error: Client connection negotiation failed: client connection to 127.13.200.189:33373: connect: Connection refused (error 111)
23:49:25.436 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.436 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.436 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.437 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.437 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.437 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.437 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.437 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.437 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.437 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.439 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.439 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.440 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.440 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.440 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.440 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.440 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.440 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.440 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.441 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.455 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:25.456 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:25.456 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:25.456 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:25.456 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:25.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:25.456 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:25.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:25.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:25.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:25.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:25.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:25.457 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:25.457 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.458 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.458 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.458 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.458 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.458 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.458 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.467270 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } attempt: 1
23:49:25.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.469766 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.189:33373: Network error: Client connection negotiation failed: client connection to 127.13.200.189:33373: connect: Connection refused (error 111)
23:49:25.500 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.500 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.501 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.501 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.501 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.501 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.501 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.501 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.502 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.528 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:25.528 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:25.529 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:25.529 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.529 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.529 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.529 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.529 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.529 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.529 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.529 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.529 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.529 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:25.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.538062 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } attempt: 2
23:49:25.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.540740 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.189:33373: Network error: Client connection negotiation failed: client connection to 127.13.200.189:33373: connect: Connection refused (error 111)
23:49:25.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468165557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:25.566 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:25.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
23:49:25.574 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:25.575 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:25.575 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:25.575 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.575 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.575 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:25.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.576 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:25.576 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.576 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:25.576 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:25.600 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.601 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.601 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.601 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.601 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.602 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.602 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.602 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.602 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.616 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.616 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.616 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.617 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.620 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.621 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.621 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.621 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.621 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.622 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.631994 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } attempt: 3
23:49:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.634353 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.189:33373: Network error: Client connection negotiation failed: client connection to 127.13.200.189:33373: connect: Connection refused (error 111)
23:49:25.635 [DEBUG - pool-184-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.9.73.190:40177, [3ms] received response from server master-127.9.73.190:40177: OK, deferred=null) with no deferred attached!
23:49:25.636 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.636 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.636 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.636 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.637 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.637 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.637 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.637 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.637 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.637 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.660 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.660 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.660 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.661 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.661 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.661 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.661 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.661 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.661 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.661 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.661 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.661 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.662 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.662 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.662 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.662 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.663 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.663 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.662 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.663 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.668 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:25.668 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:25.668 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:25.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:25.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:25.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:25.669 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:25.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:25.669 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:25.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:25.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:25.669 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:25.669 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:25.698 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.698 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.698 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.699 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.699 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.699 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.699 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.699 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.777609 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } attempt: 4
23:49:25.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.780035 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.189:33373: Network error: Client connection negotiation failed: client connection to 127.13.200.189:33373: connect: Connection refused (error 111)
23:49:25.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.803604 14248 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:25.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.803930 14248 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:25.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.804040 14248 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:25.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.813006 14248 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:25.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.813107 14248 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:25.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.813212 14248 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:25.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.813266 14248 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:25.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.813320 14248 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:25.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.813364 14248 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34261/jwks.json
23:49:25.821 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.821 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.822 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.822 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.822 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.822 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.822 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.822 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.822 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.822 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.822 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.825572 14248 master_runner.cc:387] Master server non-default flags:
23:49:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.189:33373
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34261/jwks.json
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data/info.pb
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.189
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/logs
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:25.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.827395 14248 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:25.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.829474 14248 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:25.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:25.836 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:25.836 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:25.837 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:25.837 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.837 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.837 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:25.837 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.837 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.837 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.837 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.837 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:25.837 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:25.837 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:25.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.839133 14257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:25.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.840999 14260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:25.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.847901 14258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:25.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.847972 14248 server_base.cc:1061] running on GCE node
23:49:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.848937 14248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.850769 14248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.852133 14248 hybrid_clock.cc:648] HybridClock initialized: now 1783468165852060 us; error 37 us; skew 500 ppm
23:49:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.852619 14248 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:25.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.855655 14248 webserver.cc:534] Webserver started at http://127.13.200.189:42751/ using document root <none> and password file <none>
23:49:25.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.856648 14248 fs_manager.cc:362] Metadata directory not provided
23:49:25.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.856801 14248 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:25.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.857208 14248 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:25.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.860491 14248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data/instance:
23:49:25.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b3ba3a848f64f9d9d2d39ab90de5643"
23:49:25.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:25 on dist-test-slave-hfsf"
23:49:25.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.861500 14248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal/instance:
23:49:25.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b3ba3a848f64f9d9d2d39ab90de5643"
23:49:25.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:25 on dist-test-slave-hfsf"
23:49:25.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.868491 14248 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.003s
23:49:25.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.873097 14266 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.874886 14248 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.000s
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.875123 14248 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b3ba3a848f64f9d9d2d39ab90de5643"
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:25 on dist-test-slave-hfsf"
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.875403 14248 fs_report.cc:389] FS layout report
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data/data
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:25.888 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468165888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:25.901 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:49:25.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
23:49:25.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.904675 14248 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:25.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.906224 14248 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:25.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.906579 14248 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:25.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.940465 14248 rpc_server.cc:307] RPC server started. Bound to: 127.13.200.189:33373
23:49:25.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.940708 14317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.200.189:33373 every 8 connection(s)
23:49:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.942322 14248 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/data/info.pb
23:49:25.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.946991 14114 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 14248
23:49:25.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.947190 14114 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-1/wal/instance
23:49:25.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.948606 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.948869 14114 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/logs
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data/info.pb
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.188:37429
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.188
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:25.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34261/jwks.json with env {}
23:49:25.957 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:25.958 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:25.958 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:25.958 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.958 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.958 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.958 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.958 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:25.959 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:25.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.958170 14318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } has no permanent_uuid. Determining permanent_uuid...
23:49:25.959 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.959 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.959 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:25.959 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:25.980 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:25.980 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:25.980 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:25.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.981 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:25.981 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.981 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.981 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.980599 14318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } has no permanent_uuid. Determining permanent_uuid...
23:49:25.981 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.981 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.981 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:25.982 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:25.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:25.992944 14318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
23:49:25.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:25.998860 14268 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.001487 14318 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.050930 14318 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 1
23:49:26.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.053099 14318 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468166057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:26.065 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:26.066 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
23:49:26.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.079300 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } attempt: 5
23:49:26.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.086733 14246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
23:49:26.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.089144 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.117 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.9.248.60:35483, [11ms] received response from server master-127.9.248.60:35483: OK, deferred=null) with no deferred attached!
23:49:26.117 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.9.248.60:35483, [17ms] received response from server master-127.9.248.60:35483: OK, deferred=null) with no deferred attached!
23:49:26.117 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.9.248.60:35483, [18ms] received response from server master-127.9.248.60:35483: OK, deferred=null) with no deferred attached!
23:49:26.117 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.9.248.60:35483, [20ms] received response from server master-127.9.248.60:35483: OK, deferred=null) with no deferred attached!
23:49:26.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.121371 14318 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 2
23:49:26.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.123874 14318 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.140352 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 1
23:49:26.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.143122 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.171 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:26.172 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:26.172 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:26.172 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.172 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.172 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.173 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.173 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.173 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.173 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.173 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.173 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:26.174 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29912), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [126ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [133ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [223ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [224ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [258ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [265ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [271ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [271ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [286ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [286ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [287ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [288ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [288ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [302ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [304ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [321ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [321ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [321ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [321ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [357ms] refreshing cache from master, [357ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [360ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [360ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [360ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [360ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [442ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [442ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [442ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [443ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [582ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [582ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [582ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [582ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [741ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [742ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [742ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [742ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1101ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1104ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1600ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [1604ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1604ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [2260ms] refreshing cache from master, [2260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [2261ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [2262ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [2740ms] refreshing cache from master, [2740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [2741ms] too many traces: truncated at 100 traces, deferred=Deferred@587064258(state=PENDING, result=null, callback=(continuation of Deferred@1136093332 after retry RPC after error@350436474) -> (continuation of Deferred@1069783422 after retry RPC after error@1919782583) -> (continuation of Deferred@174504870 after retry RPC after error@132859516) -> (continuation of Deferred@616572822 after retry RPC after error@986058127) -> (continuation of Deferred@96615162 after retry RPC after error@1481069720) -> (continuation of Deferred@2107516049 after retry RPC after error@2000610520) -> (continuation of Deferred@1673463087 after retry RPC after error@29261396) -> (continuation of Deferred@218658910 after retry RPC after error@219174147) -> (continuation of Deferred@371044339 after retry RPC after error@1680031674) -> (continuation of Deferred@707228136 after retry RPC after error@630231522) -> (continuation of Deferred@1577701524 after retry RPC after error@598403584) -> (continuation of Deferred@848525228 after retry RPC after error@330170269) -> (continuation of Deferred@53481484 after retry RPC after error@2008944768) -> (continuation of Deferred@1589196748 after retry RPC after error@571763345) -> (continuation of Deferred@564637359 after retry RPC after error@647659531) -> (continuation of Deferred@831181891 after retry RPC after error@810250241) -> (continuation of Deferred@746938993 after retry RPC after error@1592603954) -> (continuation of Deferred@966974048 after retry RPC after error@1384279597) -> (continuation of Deferred@1435699430 after retry RPC after error@1658905539) -> (continuation of Deferred@1304314917 after retry RPC after error@210548921) -> (continuation of Deferred@1100301814 after retry RPC after error@604915964) -> (continuation of Deferred@456048436 after retry RPC after error@1921947032) -> (continuation of Deferred@434099402 after retry RPC after error@1337992869) -> (continuation of Deferred@570029942 after retry RPC after error@668828804) -> (continuation of Deferred@1086553393 after retry RPC after error@251170434), errback=(continuation of Deferred@1136093332 after retry RPC after error@350436474) -> (continuation of Deferred@1069783422 after retry RPC after error@1919782583) -> (continuation of Deferred@174504870 after retry RPC after error@132859516) -> (continuation of Deferred@616572822 after retry RPC after error@986058127) -> (continuation of Deferred@96615162 after retry RPC after error@1481069720) -> (continuation of Deferred@2107516049 after retry RPC after error@2000610520) -> (continuation of Deferred@1673463087 after retry RPC after error@29261396) -> (continuation of Deferred@218658910 after retry RPC after error@219174147) -> (continuation of Deferred@371044339 after retry RPC after error@1680031674) -> (continuation of Deferred@707228136 after retry RPC after error@630231522) -> (continuation of Deferred@1577701524 after retry RPC after error@598403584) -> (continuation of Deferred@848525228 after retry RPC after error@330170269) -> (continuation of Deferred@53481484 after retry RPC after error@2008944768) -> (continuation of Deferred@1589196748 after retry RPC after error@571763345) -> (continuation of Deferred@564637359 after retry RPC after error@647659531) -> (continuation of Deferred@831181891 after retry RPC after error@810250241) -> (continuation of Deferred@746938993 after retry RPC after error@1592603954) -> (continuation of Deferred@966974048 after retry RPC after error@1384279597) -> (continuation of Deferred@1435699430 after retry RPC after error@1658905539) -> (continuation of Deferred@1304314917 after retry RPC after error@210548921) -> (continuation of Deferred@1100301814 after retry RPC after error@604915964) -> (continuation of Deferred@456048436 after retry RPC after error@1921947032) -> (continuation of Deferred@434099402 after retry RPC after error@1337992869) -> (continuation of Deferred@570029942 after retry RPC after error@668828804) -> (continuation of Deferred@1086553393 after retry RPC after error@251170434)))
23:49:26.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.211374 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 2
23:49:26.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.213846 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.215122 14318 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 3
23:49:26.215 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:26.215 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:26.216 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:26.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.216 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.216 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.216 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.217 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:26.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.218256 14318 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.236 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:26.236 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:26.236 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:26.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.237 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.237 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.237 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.237 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:26.256 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:26.256 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:26.256 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:26.256 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.256 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.257 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.257 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.257 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.257 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.257 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.257 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.257 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.257 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:26.258 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29986), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [45ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [50ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [54ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [54ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [182ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [186ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [190ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [191ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [253ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [258ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [259ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [259ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [281ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [281ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [282ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [282ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [302ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [334ms] refreshing cache from master, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [337ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [338ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [338ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [338ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [345ms] refreshing cache from master, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [346ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [346ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [347ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [347ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [382ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [382ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [383ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [383ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [521ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [522ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [522ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [522ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [882ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [883ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [883ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [883ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [1422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [1424ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [3440ms] refreshing cache from master, [3440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [3441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [3441ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.125:39367: Network error: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [3442ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.126:40573: Network error: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573, [3442ms] Sub RPC ConnectToMaster: received response from server master-127.6.114.124:34801: Network error: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [3443ms] delaying RPC due to: Service unavailable: Master config (127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801, [5521ms] refreshing cache from master, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.125:39367, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.126:40573, [5522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.114.124:34801, [5522ms] too many traces: truncated at 100 traces, deferred=Deferred@171553061(state=PENDING, result=null, callback=(continuation of Deferred@1064832171 after retry RPC after error@1982975345) -> (continuation of Deferred@1791018212 after retry RPC after error@758640640) -> (continuation of Deferred@1381346393 after retry RPC after error@712485159) -> (continuation of Deferred@1182580585 after retry RPC after error@1423568982) -> (continuation of Deferred@730966512 after retry RPC after error@1018692404) -> (continuation of Deferred@530347069 after retry RPC after error@73170136) -> (continuation of Deferred@572820362 after retry RPC after error@1585028441) -> (continuation of Deferred@574109495 after retry RPC after error@1164260628) -> (continuation of Deferred@1134268137 after retry RPC after error@1369063574) -> (continuation of Deferred@855135261 after retry RPC after error@1591282371) -> (continuation of Deferred@1101675319 after retry RPC after error@1110924644) -> (continuation of Deferred@849326467 after retry RPC after error@604387841) -> (continuation of Deferred@879091253 after retry RPC after error@1279355296) -> (continuation of Deferred@52288002 after retry RPC after error@375275090) -> (continuation of Deferred@206622426 after retry RPC after error@1260104345) -> (continuation of Deferred@641442866 after retry RPC after error@1106293257) -> (continuation of Deferred@1264358131 after retry RPC after error@1569044067) -> (continuation of Deferred@652510165 after retry RPC after error@1656753658) -> (continuation of Deferred@1302646875 after retry RPC after error@1029849378) -> (continuation of Deferred@1058703216 after retry RPC after error@1566044852) -> (continuation of Deferred@907724621 after retry RPC after error@434039805) -> (continuation of Deferred@1913966257 after retry RPC after error@280248341) -> (continuation of Deferred@1895095777 after retry RPC after error@513491201), errback=(continuation of Deferred@1064832171 after retry RPC after error@1982975345) -> (continuation of Deferred@1791018212 after retry RPC after error@758640640) -> (continuation of Deferred@1381346393 after retry RPC after error@712485159) -> (continuation of Deferred@1182580585 after retry RPC after error@1423568982) -> (continuation of Deferred@730966512 after retry RPC after error@1018692404) -> (continuation of Deferred@530347069 after retry RPC after error@73170136) -> (continuation of Deferred@572820362 after retry RPC after error@1585028441) -> (continuation of Deferred@574109495 after retry RPC after error@1164260628) -> (continuation of Deferred@1134268137 after retry RPC after error@1369063574) -> (continuation of Deferred@855135261 after retry RPC after error@1591282371) -> (continuation of Deferred@1101675319 after retry RPC after error@1110924644) -> (continuation of Deferred@849326467 after retry RPC after error@604387841) -> (continuation of Deferred@879091253 after retry RPC after error@1279355296) -> (continuation of Deferred@52288002 after retry RPC after error@375275090) -> (continuation of Deferred@206622426 after retry RPC after error@1260104345) -> (continuation of Deferred@641442866 after retry RPC after error@1106293257) -> (continuation of Deferred@1264358131 after retry RPC after error@1569044067) -> (continuation of Deferred@652510165 after retry RPC after error@1656753658) -> (continuation of Deferred@1302646875 after retry RPC after error@1029849378) -> (continuation of Deferred@1058703216 after retry RPC after error@1566044852) -> (continuation of Deferred@907724621 after retry RPC after error@434039805) -> (continuation of Deferred@1913966257 after retry RPC after error@280248341) -> (continuation of Deferred@1895095777 after retry RPC after error@513491201)))
23:49:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.320134 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 3
23:49:26.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.322788 14246 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.361570 14318 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 4
23:49:26.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.363783 14318 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.200.188:37429: Network error: Client connection negotiation failed: client connection to 127.13.200.188:37429: connect: Connection refused (error 111)
23:49:26.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.365195 14320 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:26.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.365501 14320 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:26.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.365588 14320 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.374691 14320 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:49:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.374858 14320 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.374955 14320 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:49:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.375043 14320 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:49:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.375111 14320 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:49:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.375147 14320 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34261/jwks.json
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.386406 14320 master_runner.cc:387] Master server non-default flags:
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal
23:49:26.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.188:37429
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34261/jwks.json
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data/info.pb
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.188
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/logs
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:26.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.388561 14320 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:26.388 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468166388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:26.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.391290 14320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:26.400 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:26.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
23:49:26.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.402386 14330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:26.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.406257 14329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:26.407 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:26.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.408077 14332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:26.408 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:26.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.408026 14320 server_base.cc:1061] running on GCE node
23:49:26.408 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:26.408 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:26.408 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:26.409 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:26.408 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:26.409 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:26.409 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:26.409 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:26.409 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:26.409 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:26.409 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:26.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.409485 14320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:26.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.411172 14320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:26.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.412477 14320 hybrid_clock.cc:648] HybridClock initialized: now 1783468166412387 us; error 60 us; skew 500 ppm
23:49:26.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.412868 14320 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:26.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.415736 14320 webserver.cc:534] Webserver started at http://127.13.200.188:44189/ using document root <none> and password file <none>
23:49:26.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.416673 14320 fs_manager.cc:362] Metadata directory not provided
23:49:26.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.416777 14320 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:26.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.417109 14320 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:26.418 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:26.419 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:26.419 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:26.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:26.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:26.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:26.419 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:26.419 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:26.419 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:26.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:26.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:26.419 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:26.419 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:26.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.420275 14320 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data/instance:
23:49:26.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "748fad8ba08b4da48ac88ef7e8538bc1"
23:49:26.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:26 on dist-test-slave-hfsf"
23:49:26.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.421082 14320 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal/instance:
23:49:26.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "748fad8ba08b4da48ac88ef7e8538bc1"
23:49:26.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:26 on dist-test-slave-hfsf"
23:49:26.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.427449 14320 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
23:49:26.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.431834 14338 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.433621 14320 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.433876 14320 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "748fad8ba08b4da48ac88ef7e8538bc1"
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:26 on dist-test-slave-hfsf"
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.434145 14320 fs_report.cc:389] FS layout report
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data/data
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:26.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.454027 14320 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:26.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.455219 14320 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:26.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.455551 14320 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.484006 14320 rpc_server.cc:307] RPC server started. Bound to: 127.13.200.188:37429
23:49:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.484091 14389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.200.188:37429 every 8 connection(s)
23:49:26.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.485903 14320 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/data/info.pb
23:49:26.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.491196 14390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:26.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.495087 14114 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 14320
23:49:26.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.495249 14114 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/master-2/wal/instance
23:49:26.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.498893 14390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } has no permanent_uuid. Determining permanent_uuid...
23:49:26.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.500063 14246 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 4
23:49:26.501 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:26.501 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:26.501 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:26.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:26.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:26.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:26.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:26.503 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:26.504 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:26.504 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.504 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:26.504 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:26.504 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:26.504 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:26.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.523836 14390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } has no permanent_uuid. Determining permanent_uuid...
23:49:26.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.531539 14246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: Bootstrap starting.
23:49:26.536 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.536718 14390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
23:49:26.537 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:26.537 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.537461 14246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: Neither blocks nor log segments found. Creating new log.
23:49:26.537 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.539 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.539 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.539 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.539 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.539247 14246 log.cc:826] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: Log is configured to *not* fsync() on all Append() calls
23:49:26.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.543228 14246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: No bootstrap required, opened a new log
23:49:26.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.552330 14246 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.552757 14246 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:26.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.552901 14246 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6b4264c3954e6d9ddbd75ec40530ee, State: Initialized, Role: FOLLOWER
23:49:26.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.553932 14246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.554361 14390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: Bootstrap starting.
23:49:26.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.555209 14400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.555548 14400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.556489 14246 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: configured and running, proceeding with master startup.
23:49:26.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468166557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:26.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.558995 14390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: Neither blocks nor log segments found. Creating new log.
23:49:26.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.560503 14390 log.cc:826] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: Log is configured to *not* fsync() on all Append() calls
23:49:26.570 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
23:49:26.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
23:49:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.572564 14390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: No bootstrap required, opened a new log
23:49:26.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.579520 14390 raft_consensus.cc:359] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.579972 14390 raft_consensus.cc:385] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:26.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.580097 14390 raft_consensus.cc:740] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748fad8ba08b4da48ac88ef7e8538bc1, State: Initialized, Role: FOLLOWER
23:49:26.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.580780 14390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.581955 14412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.582435 14412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.583499 14390 sys_catalog.cc:565] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: configured and running, proceeding with master startup.
23:49:26.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.591467 14125 master_runner.cc:187] Error getting master registration for 127.13.200.189:33373: OK, instance_id { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" instance_seqno: 1783468165932690 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:26.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.601706 14125 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:26.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.606256 14425 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:26.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.606407 14425 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:26.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.610406 14413 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
23:49:26.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.610574 14413 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
23:49:26.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.605188 14320 master_runner.cc:187] Error getting master registration for 127.13.200.189:33373: OK, instance_id { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" instance_seqno: 1783468165932690 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
23:49:26.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.612825 14320 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
23:49:26.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.661 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:26.661 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:26.661 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:26.661 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.662 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.662 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.662 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.662 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.662 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.663 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.663 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.663 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.663 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:26.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.663609 14318 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } attempt: 5
23:49:26.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.676072 14400 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:26.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.676373 14400 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.678301 14400 leader_election.cc:290] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3ba3a848f64f9d9d2d39ab90de5643 (127.13.200.189:33373), 748fad8ba08b4da48ac88ef7e8538bc1 (127.13.200.188:37429)
23:49:26.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.680574 14365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" is_pre_election: true
23:49:26.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.680773 14318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: Bootstrap starting.
23:49:26.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.681231 14365 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6b4264c3954e6d9ddbd75ec40530ee in term 0.
23:49:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.682379 14189 leader_election.cc:304] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6b4264c3954e6d9ddbd75ec40530ee, 748fad8ba08b4da48ac88ef7e8538bc1; no voters: 
23:49:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.683274 14400 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.683436 14400 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.683547 14400 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 0 FOLLOWER]: Advancing to term 1
23:49:26.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.686492 14318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: Neither blocks nor log segments found. Creating new log.
23:49:26.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.688297 14318 log.cc:826] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: Log is configured to *not* fsync() on all Append() calls
23:49:26.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.696890 14400 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.699159 14318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: No bootstrap required, opened a new log
23:49:26.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.707408 14365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748fad8ba08b4da48ac88ef7e8538bc1"
23:49:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.707720 14365 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 0 FOLLOWER]: Advancing to term 1
23:49:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.708787 14318 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.709146 14318 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.709267 14318 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3ba3a848f64f9d9d2d39ab90de5643, State: Initialized, Role: FOLLOWER
23:49:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.709741 14344 tablet.cc:2406] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.710117 14318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.714635 14365 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6b4264c3954e6d9ddbd75ec40530ee in term 1.
23:49:26.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.715638 14189 leader_election.cc:304] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6b4264c3954e6d9ddbd75ec40530ee, 748fad8ba08b4da48ac88ef7e8538bc1; no voters: 
23:49:26.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.729084 14400 leader_election.cc:290] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [CANDIDATE]: Term 1 election: Requested vote from peers 8b3ba3a848f64f9d9d2d39ab90de5643 (127.13.200.189:33373), 748fad8ba08b4da48ac88ef7e8538bc1 (127.13.200.188:37429)
23:49:26.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.734277 14400 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 1 FOLLOWER]: Leader election won for term 1
23:49:26.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.738166 14400 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [term 1 LEADER]: Becoming Leader. State: Replica: 5e6b4264c3954e6d9ddbd75ec40530ee, State: Running, Role: LEADER
23:49:26.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.747455 14400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } }
23:49:26.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.760213 14292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643"
23:49:26.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.760274 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" is_pre_election: true
23:49:26.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.760512 14429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e6b4264c3954e6d9ddbd75ec40530ee. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.760907 14429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: This master's current role is: LEADER
23:49:26.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.760851 14292 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [term 0 FOLLOWER]: Advancing to term 1
23:49:26.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.765268 14292 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6b4264c3954e6d9ddbd75ec40530ee in term 1.
23:49:26.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.760177 14318 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: configured and running, proceeding with master startup.
23:49:26.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.766604 14428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.768967 14431 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:49:26.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.773088 14431 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:49:26.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.766968 14428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:26.789559 14199 tablet.cc:2406] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:26.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.811831 14365 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [term 1 FOLLOWER]: Refusing update from remote peer 5e6b4264c3954e6d9ddbd75ec40530ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:26.812 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:26.812 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:26.813 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:26.813 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:26.813 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:26.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:26.813 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:26.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:26.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:26.813 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:26.813 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:26.813 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:26.814 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:26.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.813787 14429 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:26.815 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:26.816 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:26.816 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:26.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:26.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:26.817 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.817 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:26.817 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:26.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.822147 14292 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [term 1 FOLLOWER]: Refusing update from remote peer 5e6b4264c3954e6d9ddbd75ec40530ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:26.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.823567 14429 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:26.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:26.855 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:26.856 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:26.856 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:26.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.858 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.858 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:26.858 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:26.858 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:26.859 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:26.859 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:26.859 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.859 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.859 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:26.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:26.860 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:26.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.867045 14428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e6b4264c3954e6d9ddbd75ec40530ee. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.867333 14428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.871249 14429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.871527 14429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: This master's current role is: LEADER
23:49:26.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.872524 14435 mvcc.cc:204] Tried to move back new op lower bound from 7305085611230945280 to 7305085611015667712. Current Snapshot: MvccSnapshot[applied={T|T < 7305085611230945280}]
23:49:26.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.873747 14431 catalog_manager.cc:1382] Generated new cluster ID: 9016042d35334ccbb7ffd5617a4d8c27
23:49:26.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.873899 14431 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:49:26.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.880636 14412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e6b4264c3954e6d9ddbd75ec40530ee. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.881039 14412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.882459 14400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.883952 14400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee [sys.catalog]: This master's current role is: LEADER
23:49:26.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.884843 14428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.885128 14428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643 [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.887301 14449 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
23:49:26.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468166888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:26.905 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
23:49:26.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
23:49:26.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.906669 14442 mvcc.cc:204] Tried to move back new op lower bound from 7305085611230945280 to 7305085611015667712. Current Snapshot: MvccSnapshot[applied={T|T < 7305085611230945280 or (T in {7305085611230945280})}]
23:49:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.916349 14412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6b4264c3954e6d9ddbd75ec40530ee" member_type: VOTER last_known_addr { host: "127.13.200.190" port: 46423 } } peers { permanent_uuid: "8b3ba3a848f64f9d9d2d39ab90de5643" member_type: VOTER last_known_addr { host: "127.13.200.189" port: 33373 } } peers { permanent_uuid: "748fad8ba08b4da48ac88ef7e8538bc1" member_type: VOTER last_known_addr { host: "127.13.200.188" port: 37429 } } }
23:49:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.916657 14412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1 [sys.catalog]: This master's current role is: FOLLOWER
23:49:26.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.958979 14431 catalog_manager.cc:1405] Generated new certificate authority record
23:49:26.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:26.962193 14431 catalog_manager.cc:1539] Loading token signing keys...
23:49:26.994 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:26.994 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:26.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:26.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:26.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:26.999 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:26.999 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.000 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.000 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.000046 14431 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 5e6b4264c3954e6d9ddbd75ec40530ee: Generated new TSK 0
23:49:27.000 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.000 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.000 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.000 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:27.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.002337 14431 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.013455 14114 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/logs
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data/info.pb
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.129:0
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.200.129
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.129
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:27.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:27.058 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468167057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:27.082 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
23:49:27.084 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
23:49:27.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.268 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:27.268 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:27.269 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:27.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:27.269 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:27.269 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:27.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:27.269 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:27.269 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:27.269 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:27.269 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:27.269 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:27.269 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:27.320 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:27.321 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:27.321 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:27.321 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.321 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.321 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.321 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.322 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.322 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.322 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.322 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.322 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.322 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:27.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468167388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:27.398 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:27.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
23:49:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.498469 14452 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.499246 14452 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:27.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.499516 14452 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:27.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.514 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:27.515 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:27.515 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:27.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.515650 14452 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:27.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.516127 14452 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.200.129
23:49:27.516 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:27.516 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:27.516 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:27.517 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.517 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.517 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.517 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.517 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.517 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.517 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.531287 14452 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.129:0
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data/info.pb
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.129
23:49:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.200.129
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/logs
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:27.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:27.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.533411 14452 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.535771 14452 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:27.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.549579 14457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:27.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.552644 14458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:27.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:27.556696 14460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:27.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.557173 14452 server_base.cc:1061] running on GCE node
23:49:27.557 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:27.557 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:27.558 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:27.558 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.558 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.558 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.558 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.558 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.558 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.558 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.558 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.558 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468167557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:27.559 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.559 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:27.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.560024 14452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:27.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.562028 14452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:27.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.563947 14452 hybrid_clock.cc:648] HybridClock initialized: now 1783468167563869 us; error 66 us; skew 500 ppm
23:49:27.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.564592 14452 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:27.567 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:27.568 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
23:49:27.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.569118 14452 webserver.cc:534] Webserver started at http://127.13.200.129:35475/ using document root <none> and password file <none>
23:49:27.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.570429 14452 fs_manager.cc:362] Metadata directory not provided
23:49:27.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.570604 14452 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:27.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.571122 14452 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:27.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.576148 14452 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data/instance:
23:49:27.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "691737a8ad6d4a0db0e0fe466798ada0"
23:49:27.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:27 on dist-test-slave-hfsf"
23:49:27.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.577764 14452 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal/instance:
23:49:27.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "691737a8ad6d4a0db0e0fe466798ada0"
23:49:27.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:27 on dist-test-slave-hfsf"
23:49:27.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.588176 14452 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.004s	sys 0.004s
23:49:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.594174 14466 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:27.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.596437 14452 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.596698 14452 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "691737a8ad6d4a0db0e0fe466798ada0"
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:27 on dist-test-slave-hfsf"
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.596999 14452 fs_report.cc:389] FS layout report
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data/data
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:27.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.609339 14425 catalog_manager.cc:1294] Loaded cluster ID: 9016042d35334ccbb7ffd5617a4d8c27
23:49:27.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.609503 14425 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: loading cluster ID for follower catalog manager: success
23:49:27.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.615693 14425 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: acquiring CA information for follower catalog manager: success
23:49:27.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.619246 14425 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 748fad8ba08b4da48ac88ef7e8538bc1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:27.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.625072 14452 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:27.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.626156 14452 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:27.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.626495 14452 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:27.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.627833 14452 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.630053 14452 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.630182 14452 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.630306 14452 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.630390 14452 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:27.636 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:27.636 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:27.636 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:27.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:27.637 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:27.637 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:27.637 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:27.637 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:27.637 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:27.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:27.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:27.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:27.637 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:27.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.692152 14452 rpc_server.cc:307] RPC server started. Bound to: 127.13.200.129:45157
23:49:27.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.692176 14579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.200.129:45157 every 8 connection(s)
23:49:27.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.694087 14452 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/data/info.pb
23:49:27.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.696398 14114 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 14452
23:49:27.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.696625 14114 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-0/wal/instance
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.706779 14114 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/logs
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data/info.pb
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.130:0
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.200.130
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.130
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:27.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.737676 14580 heartbeater.cc:344] Connected to a master server at 127.13.200.188:37429
23:49:27.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.738242 14580 heartbeater.cc:461] Registering TS with master...
23:49:27.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.739642 14580 heartbeater.cc:507] Master 127.13.200.188:37429 requested a full tablet report, sending...
23:49:27.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.742686 14355 ts_manager.cc:194] Registered new tserver with Master: 691737a8ad6d4a0db0e0fe466798ada0 (127.13.200.129:45157)
23:49:27.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.742868 14581 heartbeater.cc:344] Connected to a master server at 127.13.200.190:46423
23:49:27.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.743008 14581 heartbeater.cc:461] Registering TS with master...
23:49:27.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.743613 14581 heartbeater.cc:507] Master 127.13.200.190:46423 requested a full tablet report, sending...
23:49:27.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.745378 14210 ts_manager.cc:194] Registered new tserver with Master: 691737a8ad6d4a0db0e0fe466798ada0 (127.13.200.129:45157)
23:49:27.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.747430 14582 heartbeater.cc:344] Connected to a master server at 127.13.200.189:33373
23:49:27.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.747601 14582 heartbeater.cc:461] Registering TS with master...
23:49:27.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.747831 14210 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.200.129:52621
23:49:27.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.748121 14582 heartbeater.cc:507] Master 127.13.200.189:33373 requested a full tablet report, sending...
23:49:27.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.750034 14283 ts_manager.cc:194] Registered new tserver with Master: 691737a8ad6d4a0db0e0fe466798ada0 (127.13.200.129:45157)
23:49:27.779 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:27.780 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:27.780 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:27.780 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:27.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:27.780 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:27.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:27.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:27.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:27.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:27.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:27.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:27.781 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:27.816 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:27.816 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:27.816 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:27.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.817 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.817 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:27.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:27.817 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.817 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.817 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:27.817 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:27.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:27.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:27.827 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:27.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:27.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:27.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:27.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:27.828 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.828 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:27.828 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:27.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:27.895 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468167894 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:27.905 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:27.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
23:49:27.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.907343 14449 catalog_manager.cc:1294] Loaded cluster ID: 9016042d35334ccbb7ffd5617a4d8c27
23:49:27.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.907503 14449 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: loading cluster ID for follower catalog manager: success
23:49:27.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.911096 14449 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: acquiring CA information for follower catalog manager: success
23:49:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:27.913987 14449 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 8b3ba3a848f64f9d9d2d39ab90de5643: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
23:49:28.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.020 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:28.021 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:28.021 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:28.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:28.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:28.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:28.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:28.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:28.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:28.022 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:28.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:28.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:28.022 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:28.057 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468168057 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:28.066 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:28.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
23:49:28.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.188060 14587 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.188508 14587 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.188638 14587 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:28.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.202594 14587 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:28.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.202883 14587 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.200.130
23:49:28.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.220475 14587 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:28.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:28.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.130:0
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data/info.pb
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.130
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.200.130
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/logs
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:28.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.222887 14587 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:28.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.225489 14587 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:28.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.239461 14597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:28.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.243191 14598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:28.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.250100 14600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:28.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.252039 14587 server_base.cc:1061] running on GCE node
23:49:28.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.252837 14587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:28.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.255156 14587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:28.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.256402 14587 hybrid_clock.cc:648] HybridClock initialized: now 1783468168256329 us; error 76 us; skew 500 ppm
23:49:28.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.256821 14587 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:28.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.259994 14587 webserver.cc:534] Webserver started at http://127.13.200.130:41965/ using document root <none> and password file <none>
23:49:28.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.261215 14587 fs_manager.cc:362] Metadata directory not provided
23:49:28.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.261365 14587 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:28.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.261783 14587 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.265106 14587 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data/instance:
23:49:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33df8878c6574ef9a87d780861828aea"
23:49:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:28 on dist-test-slave-hfsf"
23:49:28.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.266325 14587 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal/instance:
23:49:28.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33df8878c6574ef9a87d780861828aea"
23:49:28.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:28 on dist-test-slave-hfsf"
23:49:28.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.274298 14587 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
23:49:28.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.279543 14606 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.281352 14587 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
23:49:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.281582 14587 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal
23:49:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33df8878c6574ef9a87d780861828aea"
23:49:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:28 on dist-test-slave-hfsf"
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.281831 14587 fs_report.cc:389] FS layout report
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data/data
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:28.296 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:28.297 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:28.297 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:28.297 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:28.297 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:28.297 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:28.297 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:28.297 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:28.297 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:28.298 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:28.298 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:28.298 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:28.298 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:28.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.328303 14587 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:28.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.329442 14587 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:28.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.329842 14587 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:28.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.331073 14587 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:28.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.334085 14587 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:28.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.334234 14587 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:28.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.334371 14587 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:28.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.334463 14587 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:28.347 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:28.348 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:28.348 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:28.348 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:28.348 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:28.348 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:28.349 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:28.349 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:28.349 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:28.349 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:28.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:28.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:28.349 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:28.374 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:28.374 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:28.374 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:28.375 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:28.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:28.375 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:28.375 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:28.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:28.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:28.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:28.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:28.376 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:28.376 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:28.388 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468168388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:28.398 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:28.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
23:49:28.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.433578 14587 rpc_server.cc:307] RPC server started. Bound to: 127.13.200.130:37033
23:49:28.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.433692 14720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.200.130:37033 every 8 connection(s)
23:49:28.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.435729 14587 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/data/info.pb
23:49:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.437836 14114 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 14587
23:49:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.438076 14114 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-1/wal/instance
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.445775 14114 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/logs
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data/info.pb
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.131:0
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.200.131
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.131
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
23:49:28.501 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.507644 14722 heartbeater.cc:344] Connected to a master server at 127.13.200.190:46423
23:49:28.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.508353 14722 heartbeater.cc:461] Registering TS with master...
23:49:28.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.510633 14722 heartbeater.cc:507] Master 127.13.200.190:46423 requested a full tablet report, sending...
23:49:28.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.512465 14721 heartbeater.cc:344] Connected to a master server at 127.13.200.188:37429
23:49:28.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.512648 14721 heartbeater.cc:461] Registering TS with master...
23:49:28.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.513355 14721 heartbeater.cc:507] Master 127.13.200.188:37429 requested a full tablet report, sending...
23:49:28.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.516000 14210 ts_manager.cc:194] Registered new tserver with Master: 33df8878c6574ef9a87d780861828aea (127.13.200.130:37033)
23:49:28.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.517537 14210 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.200.130:39761
23:49:28.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.518157 14355 ts_manager.cc:194] Registered new tserver with Master: 33df8878c6574ef9a87d780861828aea (127.13.200.130:37033)
23:49:28.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.532038 14726 heartbeater.cc:344] Connected to a master server at 127.13.200.189:33373
23:49:28.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.532330 14726 heartbeater.cc:461] Registering TS with master...
23:49:28.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.532764 14726 heartbeater.cc:507] Master 127.13.200.189:33373 requested a full tablet report, sending...
23:49:28.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.534217 14283 ts_manager.cc:194] Registered new tserver with Master: 33df8878c6574ef9a87d780861828aea (127.13.200.130:37033)
23:49:28.557 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468168557 for job c4b00a34e6633561fb08795709e8dcd8.
23:49:28.565 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job c4b00a34e6633561fb08795709e8dcd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:28.566 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
23:49:28.633 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:28.633 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:28.634 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:28.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:28.634 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:28.634 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:28.634 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:28.634 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:28.634 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:28.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:28.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:28.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:28.635 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:28.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.751224 14581 heartbeater.cc:499] Master 127.13.200.190:46423 was elected leader, sending a full tablet report...
23:49:28.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:28.888 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468168888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:28.900 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:28.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
23:49:28.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.915330 14725 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:49:28.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.915733 14725 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:49:28.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.915848 14725 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:49:28.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.924995 14725 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:49:28.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.925278 14725 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.200.131
23:49:28.936 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:28.936 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:28.936 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:28.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.936 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.936 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.937 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.937 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:28.937 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29401), Traces: [0ms] sending RPC to server master-127.9.73.190:40177, [53ms] received response from server master-127.9.73.190:40177: Network error: connection closed, [53ms] delaying RPC due to: Network error: connection closed, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [174ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [174ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [198ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [199ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [219ms] refreshing cache from master, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [321ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [346ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [379ms] refreshing cache from master, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [381ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [439ms] refreshing cache from master, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [440ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [441ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [559ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [561ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [759ms] refreshing cache from master, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [760ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [859ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [861ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [1741ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2799ms] refreshing cache from master, [2799ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2802ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4961ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [5979ms] refreshing cache from master, [5980ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@12641aab -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584)))
23:49:28.938 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:28.938 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29401), Traces: [0ms] sending RPC to server master-127.9.73.190:40177, [53ms] received response from server master-127.9.73.190:40177: Network error: connection closed, [53ms] delaying RPC due to: Network error: connection closed, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [174ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [174ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [198ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [199ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [219ms] refreshing cache from master, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [321ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [346ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [379ms] refreshing cache from master, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [381ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [439ms] refreshing cache from master, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [440ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [441ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [559ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [561ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [759ms] refreshing cache from master, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [760ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [859ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [861ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [1741ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2799ms] refreshing cache from master, [2799ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2802ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4961ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [5979ms] refreshing cache from master, [5980ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@12641aab -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29401), Traces: [0ms] sending RPC to server master-127.9.73.190:40177, [53ms] received response from server master-127.9.73.190:40177: Network error: connection closed, [53ms] delaying RPC due to: Network error: connection closed, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [174ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [174ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [198ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [199ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [219ms] refreshing cache from master, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [321ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [346ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [379ms] refreshing cache from master, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [381ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [439ms] refreshing cache from master, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [440ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [441ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [559ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [561ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [759ms] refreshing cache from master, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [760ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [859ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [861ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [1741ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2799ms] refreshing cache from master, [2799ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2802ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4961ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [5979ms] refreshing cache from master, [5980ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@12641aab -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.73.189:33103
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:28.938 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:28.939 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.938711 14725 tablet_server_runner.cc:78] Tablet server non-default flags:
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.200.148:35439
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.200.131:0
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data/info.pb
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.200.131
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.200.190:46423,127.13.200.189:33373,127.13.200.188:37429
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.200.131
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/logs
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66915500c9e327897c442aea7b3936de4ff5c319
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:49:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 23:36:41 UTC on bdcb31816ec0
23:49:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16835
23:49:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
23:49:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.941044 14725 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:49:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.943415 14725 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:49:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.965894 14736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:28.971 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29401), Traces: [0ms] sending RPC to server master-127.9.73.190:40177, [53ms] received response from server master-127.9.73.190:40177: Network error: connection closed, [53ms] delaying RPC due to: Network error: connection closed, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [174ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [174ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [198ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [199ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [219ms] refreshing cache from master, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [321ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [346ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [379ms] refreshing cache from master, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [381ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [439ms] refreshing cache from master, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [440ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [441ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [559ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [561ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [759ms] refreshing cache from master, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [760ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [859ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [861ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [1741ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2799ms] refreshing cache from master, [2799ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2802ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4961ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [5979ms] refreshing cache from master, [5980ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@12641aab -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29401), Traces: [0ms] sending RPC to server master-127.9.73.190:40177, [53ms] received response from server master-127.9.73.190:40177: Network error: connection closed, [53ms] delaying RPC due to: Network error: connection closed, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [174ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: OK, [174ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [182ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [198ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [199ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.189:33103(127.9.73.189:33103)] unexpected exception from downstream on [id: 0x3182acf0, L:/127.0.0.1:33124 - R:/127.9.73.189:33103], [219ms] refreshing cache from master, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [221ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: OK, [321ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [341ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [346ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: [peer master-127.9.73.188:35043(127.9.73.188:35043)] unexpected exception from downstream on [id: 0x6e3d7ca8, L:/127.0.0.1:57280 - R:/127.9.73.188:35043], [379ms] refreshing cache from master, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [380ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [381ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [439ms] refreshing cache from master, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [440ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [441ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [441ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [559ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [561ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [561ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [759ms] refreshing cache from master, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [759ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [760ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [760ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [859ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [861ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [861ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [1741ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [1741ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2799ms] refreshing cache from master, [2799ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [2802ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.188:35043, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.189:33103, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.73.190:40177, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.188:35043: Network error: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.189:33103: Network error: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103, [4961ms] Sub RPC ConnectToMaster: received response from server master-127.9.73.190:40177: Network error: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177, [4961ms] delaying RPC due to: Service unavailable: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043, [5979ms] refreshing cache from master, [5980ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$231/0x00007fa47032f750@12641aab -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@392902948 after retry RPC after error@1594787917) -> (continuation of Deferred@1646423962 after retry RPC after error@1344372791) -> (continuation of Deferred@508375310 after retry RPC after error@891981418) -> (continuation of Deferred@1149598186 after retry RPC after error@418998645) -> (continuation of Deferred@1875635749 after retry RPC after error@242447464) -> (continuation of Deferred@1633031781 after retry RPC after error@842492411) -> (continuation of Deferred@37552990 after retry RPC after error@393799493) -> (continuation of Deferred@1179397873 after retry RPC after error@1329459058) -> (continuation of Deferred@636498488 after retry RPC after error@1977789196) -> (continuation of Deferred@1392388327 after retry RPC after error@1914178485) -> (continuation of Deferred@1448973884 after retry RPC after error@906489136) -> (continuation of Deferred@362631687 after retry RPC after error@661300898) -> (continuation of Deferred@490485765 after retry RPC after error@349907199) -> (continuation of Deferred@1806257417 after retry RPC after error@428124520) -> (continuation of Deferred@1694778957 after retry RPC after error@676660930) -> (continuation of Deferred@162912196 after retry RPC after error@893837427) -> (continuation of Deferred@1916268216 after retry RPC after error@1918141738) -> (continuation of Deferred@1433954131 after retry RPC after error@1472151799) -> (continuation of Deferred@447751830 after retry RPC after error@1285262655) -> (continuation of Deferred@1523529984 after retry RPC after error@2010804822) -> (continuation of Deferred@1824882349 after retry RPC after error@2091381887) -> (continuation of Deferred@1602475474 after retry RPC after error@2079278262) -> (continuation of Deferred@1016626544 after retry RPC after error@2136957584)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.9.73.189:33103
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
23:49:28.965 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.972 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.973 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.939 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:28.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.971451 14737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:28.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:28.972543 14739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:49:28.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.973 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
23:49:28.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.973 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:28.974 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c4b00a34e6633561fb08795709e8dcd8) switched from state RUNNING to RESTARTING.
23:49:28.974 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
23:49:28.974 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
23:49:28.975 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
23:49:28.975 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
23:49:28.975 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:49:28.975 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
23:49:28.975 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:49:28.975 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
23:49:28.975 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
23:49:28.975 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
23:49:28.975 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
23:49:28.980 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:49:28.980 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
23:49:28.980 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:49:28.980 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.9.248.61:36251(127.9.248.61:36251)] disconnecting while in state TERMINATED
23:49:28.980 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.9.248.62:39393(127.9.248.62:39393)] disconnecting while in state TERMINATED
23:49:28.981 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.9.248.60:35483(127.9.248.60:35483)] disconnecting while in state TERMINATED
23:49:28.981 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:49:28.981 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
23:49:28.981 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:49:28.981 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:28.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.981882 14725 server_base.cc:1061] running on GCE node
23:49:28.982 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.9.248.61:36251(127.9.248.61:36251)] disconnecting while in state TERMINATED
23:49:28.982 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.9.248.62:39393(127.9.248.62:39393)] disconnecting while in state TERMINATED
23:49:28.982 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.9.248.60:35483(127.9.248.60:35483)] disconnecting while in state TERMINATED
23:49:28.982 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 0bbd3b7684d64d54bae378c85bb641f3(127.9.248.2:38803)] disconnecting while in state TERMINATED
23:49:28.983 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:28.983 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
23:49:28.983 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:49:28.983 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
23:49:28.983 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:49:28.983 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:49:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.983258 14725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:49:28.985 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.9.248.61:36251(127.9.248.61:36251)] disconnecting while in state TERMINATED
23:49:28.985 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.9.248.62:39393(127.9.248.62:39393)] disconnecting while in state TERMINATED
23:49:28.985 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.9.248.60:35483(127.9.248.60:35483)] disconnecting while in state TERMINATED
23:49:28.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.985776 14725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:49:28.987 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:28.987 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:49:28.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.989667 14725 hybrid_clock.cc:648] HybridClock initialized: now 1783468168989552 us; error 69 us; skew 500 ppm
23:49:28.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.990291 14725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:49:28.990 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:49:28.991 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
23:49:28.991 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:49:28.991 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:28.992 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
23:49:28.992 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
23:49:28.992 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
23:49:28.993 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:28.993 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
23:49:28.993 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
23:49:28.995 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-3
23:49:28.995 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:28.996 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:28.996 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:28.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:28.997 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:28.997 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:28.998 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:28.998 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:49:28.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:28.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
23:49:28.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
23:49:29.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:28.999560 14725 webserver.cc:534] Webserver started at http://127.13.200.131:46267/ using document root <none> and password file <none>
23:49:29.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.002 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
23:49:29.002 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
23:49:29.002 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
23:49:29.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.001041 14725 fs_manager.cc:362] Metadata directory not provided
23:49:29.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.001294 14725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:49:29.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.001842 14725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:49:29.002 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
23:49:29.003 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:29.003 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
23:49:29.004 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
23:49:29.005 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:29.005 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:29.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.006388 14725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data/instance:
23:49:29.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aefe2d10642e44bc9221ed478fff1f6b"
23:49:29.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:28 on dist-test-slave-hfsf"
23:49:29.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.007747 14725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal/instance:
23:49:29.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aefe2d10642e44bc9221ed478fff1f6b"
23:49:29.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:28 on dist-test-slave-hfsf"
23:49:29.009 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.9.248.61:36251(127.9.248.61:36251)] disconnecting while in state TERMINATED
23:49:29.010 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.9.248.62:39393(127.9.248.62:39393)] disconnecting while in state TERMINATED
23:49:29.010 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.9.248.60:35483(127.9.248.60:35483)] disconnecting while in state TERMINATED
23:49:29.010 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:29.010 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
23:49:29.011 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
23:49:29.011 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
23:49:29.011 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
23:49:29.012 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
23:49:29.012 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
23:49:29.012 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
23:49:29.012 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
23:49:29.013 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job c4b00a34e6633561fb08795709e8dcd8
23:49:29.016 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.016 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.016 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.016 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.017 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.017 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.017 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.017 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.017513 14725 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.003s	sys 0.004s
23:49:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.022611 14765 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:49:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.024669 14725 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.024896 14725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data,/tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aefe2d10642e44bc9221ed478fff1f6b"
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:49:28 on dist-test-slave-hfsf"
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.025209 14725 fs_report.cc:389] FS layout report
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data/data
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:49:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:49:29.036 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.036 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.036 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.037 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.037 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.037 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.037 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.037 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.050695 14725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:49:29.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.051766 14725 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:49:29.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.052067 14725 kserver.cc:163] Server-wide thread pool size limit: 3276
23:49:29.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.053313 14725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:49:29.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.055711 14725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:49:29.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.055807 14725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:49:29.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.055882 14725 ts_tablet_manager.cc:616] Registered 0 tablets
23:49:29.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.055960 14725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:49:29.056 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.056 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.056 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.057 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.057 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.057 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.057 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.057 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.095 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.095 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.096 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.096 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.096 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.096 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.096381 14725 rpc_server.cc:307] RPC server started. Bound to: 127.13.200.131:45981
23:49:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.096660 14877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.200.131:45981 every 8 connection(s)
23:49:29.096 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.096 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.096 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.096 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.097 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.097 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.098248 14725 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/data/info.pb
23:49:29.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.107846 14114 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu as pid 14725
23:49:29.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.108029 14114 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZ1k3RW/test-tmp/mini-kudu-cluster2070309587738908045/ts-2/wal/instance
23:49:29.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.121336 14880 heartbeater.cc:344] Connected to a master server at 127.13.200.189:33373
23:49:29.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.121816 14880 heartbeater.cc:461] Registering TS with master...
23:49:29.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.122437 14878 heartbeater.cc:344] Connected to a master server at 127.13.200.188:37429
23:49:29.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.122620 14878 heartbeater.cc:461] Registering TS with master...
23:49:29.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.122632 14879 heartbeater.cc:344] Connected to a master server at 127.13.200.190:46423
23:49:29.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.122860 14879 heartbeater.cc:461] Registering TS with master...
23:49:29.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.123340 14880 heartbeater.cc:507] Master 127.13.200.189:33373 requested a full tablet report, sending...
23:49:29.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.123464 14879 heartbeater.cc:507] Master 127.13.200.190:46423 requested a full tablet report, sending...
23:49:29.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.123572 14878 heartbeater.cc:507] Master 127.13.200.188:37429 requested a full tablet report, sending...
23:49:29.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.125285 14355 ts_manager.cc:194] Registered new tserver with Master: aefe2d10642e44bc9221ed478fff1f6b (127.13.200.131:45981)
23:49:29.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.125361 14210 ts_manager.cc:194] Registered new tserver with Master: aefe2d10642e44bc9221ed478fff1f6b (127.13.200.131:45981)
23:49:29.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.125504 14283 ts_manager.cc:194] Registered new tserver with Master: aefe2d10642e44bc9221ed478fff1f6b (127.13.200.131:45981)
23:49:29.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.126437 14210 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.200.131:46717
23:49:29.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.136328 14114 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:49:29.138 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:49:29.138 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:49:29.140 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.200.190"
      port: 46423
    }
    bound_http_address {
      host: "127.13.200.190"
      port: 35393
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.200.189"
      port: 33373
    }
    bound_http_address {
      host: "127.13.200.189"
      port: 42751
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.200.188"
      port: 37429
    }
    bound_http_address {
      host: "127.13.200.188"
      port: 44189
    }
  }
}

23:49:29.140 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:49:29.141 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.200.129"
      port: 45157
    }
    bound_http_address {
      host: "127.13.200.129"
      port: 35475
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.200.130"
      port: 37033
    }
    bound_http_address {
      host: "127.13.200.130"
      port: 41965
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.200.131"
      port: 45981
    }
    bound_http_address {
      host: "127.13.200.131"
      port: 46267
    }
  }
}

23:49:29.141 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:49:29.142 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:29.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.145 [DEBUG - main] (Connection.java:748) [peer master-127.13.20.61:45687(127.13.20.61:45687)] connecting to peer
23:49:29.146 [DEBUG - main] (Connection.java:748) [peer master-127.13.20.62:35095(127.13.20.62:35095)] connecting to peer
23:49:29.147 [DEBUG - main] (Connection.java:748) [peer master-127.13.20.60:44081(127.13.20.60:44081)] connecting to peer
23:49:29.147 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.20.61:45687(127.13.20.61:45687)] Successfully connected to peer
23:49:29.151 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.20.62:35095(127.13.20.62:35095)] Successfully connected to peer
23:49:29.153 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.62
23:49:29.153 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.61
23:49:29.157 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.157 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.157 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.158 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.158 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.159 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.161 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.20.60:44081(127.13.20.60:44081)] Successfully connected to peer
23:49:29.163 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.60
23:49:29.163 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.163 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.166 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8eae5454, L:/127.0.0.1:54764 - R:/127.13.20.61:45687] using SASL/PLAIN
23:49:29.167 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x362913f3, L:/127.0.0.1:47516 - R:/127.13.20.62:35095] using SASL/PLAIN
23:49:29.175 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.177 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x23504b0c, L:/127.0.0.1:46374 - R:/127.13.20.60:44081] using SASL/PLAIN
23:49:29.180 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:29.180 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=35), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.61:45687, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.62:35095, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.60:44081, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.61:45687: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.62:35095: OK, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.60:44081: OK, deferred=null) after lookup
23:49:29.181 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:29.181 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:29.181 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:29.181 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.182 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.182 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.182 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.182 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.182 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.182 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.182 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:29.188 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:29.188 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:29.189 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.188169 13582 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46374:
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:29.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:29.191237 13582 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:49:29.192 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:29.192 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:29.192 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:29.193 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:29.193 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:29.193 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:29.193 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:29.193 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:29.193 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:29.194 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:29.255 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.255 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.256 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.256 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.256 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.256 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.256 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.256 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.257 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.278 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:29.279 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:29.279 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:29.279 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:29.279 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:29.279 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:29.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:29.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:29.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:29.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:29.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:29.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:29.280 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:29.292 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bfb5c8aacb224daf932941283bbed429
23:49:29.316 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.316 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.316 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.317 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.317 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.317 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.317 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.317 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.340 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:29.341 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:29.341 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:29.341 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:29.341 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:29.341 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:29.341 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:29.341 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:29.341 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:29.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:29.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:29.342 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:29.342 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:29.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.343380 14039 tablet_service.cc:1511] Processing CreateTablet for tablet 7585754decfe4ef685de7df84711d164 (DEFAULT_TABLE table=replication_test_table [id=bfb5c8aacb224daf932941283bbed429]), partition=RANGE (int8) PARTITION UNBOUNDED
23:49:29.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.345170 14039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7585754decfe4ef685de7df84711d164. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:29.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.348606 13740 tablet_service.cc:1511] Processing CreateTablet for tablet 7585754decfe4ef685de7df84711d164 (DEFAULT_TABLE table=replication_test_table [id=bfb5c8aacb224daf932941283bbed429]), partition=RANGE (int8) PARTITION UNBOUNDED
23:49:29.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.350287 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7585754decfe4ef685de7df84711d164. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:29.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.353157 13890 tablet_service.cc:1511] Processing CreateTablet for tablet 7585754decfe4ef685de7df84711d164 (DEFAULT_TABLE table=replication_test_table [id=bfb5c8aacb224daf932941283bbed429]), partition=RANGE (int8) PARTITION UNBOUNDED
23:49:29.356 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:29.356 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:29.356 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:29.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.356880 13890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7585754decfe4ef685de7df84711d164. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:29.357 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.357 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.357 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.357 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.357 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.357 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.358 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:29.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.372112 14913 tablet_bootstrap.cc:492] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: Bootstrap starting.
23:49:29.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.378650 14913 tablet_bootstrap.cc:654] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: Neither blocks nor log segments found. Creating new log.
23:49:29.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.380793 14913 log.cc:826] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: Log is configured to *not* fsync() on all Append() calls
23:49:29.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.387441 14914 tablet_bootstrap.cc:492] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: Bootstrap starting.
23:49:29.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468169388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:29.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.393749 14914 tablet_bootstrap.cc:654] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: Neither blocks nor log segments found. Creating new log.
23:49:29.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.397275 14914 log.cc:826] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: Log is configured to *not* fsync() on all Append() calls
23:49:29.398 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:29.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
23:49:29.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.404469 14913 tablet_bootstrap.cc:492] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: No bootstrap required, opened a new log
23:49:29.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.404923 14913 ts_tablet_manager.cc:1403] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.010s
23:49:29.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.405846 14917 tablet_bootstrap.cc:492] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: Bootstrap starting.
23:49:29.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.409351 14914 tablet_bootstrap.cc:492] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: No bootstrap required, opened a new log
23:49:29.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.409885 14914 ts_tablet_manager.cc:1403] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.009s
23:49:29.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.414342 14913 raft_consensus.cc:359] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.414912 14913 raft_consensus.cc:385] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:29.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.415035 14913 raft_consensus.cc:740] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a509248df44364b082f3958d577ee7, State: Initialized, Role: FOLLOWER
23:49:29.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.416076 14913 consensus_queue.cc:260] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.421504 14917 tablet_bootstrap.cc:654] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: Neither blocks nor log segments found. Creating new log.
23:49:29.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.426134 14917 log.cc:826] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: Log is configured to *not* fsync() on all Append() calls
23:49:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.429203 14914 raft_consensus.cc:359] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.429656 14914 raft_consensus.cc:385] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.429791 14914 raft_consensus.cc:740] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f8ef3cb80cd4033b631ffe32cdb0ee4, State: Initialized, Role: FOLLOWER
23:49:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.430614 14914 consensus_queue.cc:260] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.433279 14914 ts_tablet_manager.cc:1434] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.000s
23:49:29.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.437640 14913 ts_tablet_manager.cc:1434] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: Time spent starting tablet: real 0.032s	user 0.013s	sys 0.015s
23:49:29.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.439414 14917 tablet_bootstrap.cc:492] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: No bootstrap required, opened a new log
23:49:29.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.439760 14917 ts_tablet_manager.cc:1403] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
23:49:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:29.444768 14107 tablet.cc:2406] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:29.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.448346 14917 raft_consensus.cc:359] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.449050 14917 raft_consensus.cc:385] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:29.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.449288 14917 raft_consensus.cc:740] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e870894e7d424a0b9e3746c78d9e0156, State: Initialized, Role: FOLLOWER
23:49:29.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.450148 14917 consensus_queue.cc:260] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.452649 14917 ts_tablet_manager.cc:1434] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.002s
23:49:29.476 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:29.476 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:29.476 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:29.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.477 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:29.477 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.477 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:29.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:29.477 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:29.501 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:29.508741 13808 tablet.cc:2406] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:29.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.522606 14722 heartbeater.cc:499] Master 127.13.200.190:46423 was elected leader, sending a full tablet report...
23:49:29.532 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:29.532 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:29.532 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:29.532 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:29.532 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:29.533 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:29.533 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:29.533 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:29.533 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:29.533 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:29.533 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:29.533 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:29.533 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:29.555 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:29.556 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:29.556 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:29.556 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.556 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.556 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:29.556 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.557 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.557 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:29.557 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.557 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.557 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:29.557 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:29.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.570050 14921 raft_consensus.cc:493] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:29.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.570303 14921 raft_consensus.cc:515] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.572496 14921 leader_election.cc:290] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a509248df44364b082f3958d577ee7 (127.13.20.1:46877), 2f8ef3cb80cd4033b631ffe32cdb0ee4 (127.13.20.3:43797)
23:49:29.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.582484 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7585754decfe4ef685de7df84711d164" candidate_uuid: "e870894e7d424a0b9e3746c78d9e0156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a509248df44364b082f3958d577ee7" is_pre_election: true
23:49:29.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.582670 14059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7585754decfe4ef685de7df84711d164" candidate_uuid: "e870894e7d424a0b9e3746c78d9e0156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" is_pre_election: true
23:49:29.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.583164 13760 raft_consensus.cc:2468] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e870894e7d424a0b9e3746c78d9e0156 in term 0.
23:49:29.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.583225 14059 raft_consensus.cc:2468] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e870894e7d424a0b9e3746c78d9e0156 in term 0.
23:49:29.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.584004 13838 leader_election.cc:304] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a509248df44364b082f3958d577ee7, e870894e7d424a0b9e3746c78d9e0156; no voters: 
23:49:29.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.584564 14921 raft_consensus.cc:2804] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:29.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.584741 14921 raft_consensus.cc:493] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:29.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.584864 14921 raft_consensus.cc:3060] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 0 FOLLOWER]: Advancing to term 1
23:49:29.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.587774 14921 raft_consensus.cc:515] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.589226 14921 leader_election.cc:290] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [CANDIDATE]: Term 1 election: Requested vote from peers a1a509248df44364b082f3958d577ee7 (127.13.20.1:46877), 2f8ef3cb80cd4033b631ffe32cdb0ee4 (127.13.20.3:43797)
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.589486 14059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7585754decfe4ef685de7df84711d164" candidate_uuid: "e870894e7d424a0b9e3746c78d9e0156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4"
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.589695 14059 raft_consensus.cc:3060] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 0 FOLLOWER]: Advancing to term 1
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.592283 14059 raft_consensus.cc:2468] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e870894e7d424a0b9e3746c78d9e0156 in term 1.
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.592913 13835 leader_election.cc:304] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f8ef3cb80cd4033b631ffe32cdb0ee4, e870894e7d424a0b9e3746c78d9e0156; no voters: 
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.593374 14921 raft_consensus.cc:2804] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 1 FOLLOWER]: Leader election won for term 1
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.594097 14921 raft_consensus.cc:697] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [term 1 LEADER]: Becoming Leader. State: Replica: e870894e7d424a0b9e3746c78d9e0156, State: Running, Role: LEADER
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.595113 14921 consensus_queue.cc:237] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } }
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.595479 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7585754decfe4ef685de7df84711d164" candidate_uuid: "e870894e7d424a0b9e3746c78d9e0156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a509248df44364b082f3958d577ee7"
23:49:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.595747 13760 raft_consensus.cc:3060] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 0 FOLLOWER]: Advancing to term 1
23:49:29.598 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:29.599 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:29.599 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:29.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:29.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:29.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.599874 13760 raft_consensus.cc:2468] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e870894e7d424a0b9e3746c78d9e0156 in term 1.
23:49:29.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:29.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:29.601 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:29.601 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:29.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:29.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:29.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:29.601 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:29.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.604195 13581 catalog_manager.cc:5696] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 reported cstate change: term changed from 0 to 1, leader changed from <none> to e870894e7d424a0b9e3746c78d9e0156 (127.13.20.2). New cstate: current_term: 1 leader_uuid: "e870894e7d424a0b9e3746c78d9e0156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e870894e7d424a0b9e3746c78d9e0156" member_type: VOTER last_known_addr { host: "127.13.20.2" port: 33087 } health_report { overall_health: HEALTHY } } }
23:49:29.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:29.608129 13958 tablet.cc:2406] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:29.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.710 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bfb5c8aacb224daf932941283bbed429
23:49:29.723 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7585754decfe4ef685de7df84711d164 for table 'replication_test_table' with partition [<start>, <end>)
23:49:29.723 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7585754decfe4ef685de7df84711d164@[2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797),a1a509248df44364b082f3958d577ee7(127.13.20.1:46877),e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)[L]]}]
23:49:29.723 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.13.20.60:44081, [3ms] Sub RPC GetTableLocations: received response from server master-127.13.20.60:44081: OK, deferred=null) after lookup
23:49:29.724 [DEBUG - kudu-nio-2] (Connection.java:748) [peer e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)] connecting to peer
23:49:29.725 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)] Successfully connected to peer
23:49:29.734 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.737 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xadaf96bb, L:/127.0.0.1:60866 - R:/127.13.20.2:33087] using TOKEN/null
23:49:29.747 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:29.747 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:29.747 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:29.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:29.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:29.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:29.748 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:29.748 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:29.748 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:29.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.748037 13760 raft_consensus.cc:1275] T 7585754decfe4ef685de7df84711d164 P a1a509248df44364b082f3958d577ee7 [term 1 FOLLOWER]: Refusing update from remote peer e870894e7d424a0b9e3746c78d9e0156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:29.748 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:29.748 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:29.748 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:29.748 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:29.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.749576 14921 consensus_queue.cc:1048] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a509248df44364b082f3958d577ee7" member_type: VOTER last_known_addr { host: "127.13.20.1" port: 46877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:29.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.749706 14059 raft_consensus.cc:1275] T 7585754decfe4ef685de7df84711d164 P 2f8ef3cb80cd4033b631ffe32cdb0ee4 [term 1 FOLLOWER]: Refusing update from remote peer e870894e7d424a0b9e3746c78d9e0156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
23:49:29.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.750703 14921 consensus_queue.cc:1048] T 7585754decfe4ef685de7df84711d164 P e870894e7d424a0b9e3746c78d9e0156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f8ef3cb80cd4033b631ffe32cdb0ee4" member_type: VOTER last_known_addr { host: "127.13.20.3" port: 43797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:29.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.767974 14927 mvcc.cc:204] Tried to move back new op lower bound from 7305085623274737664 to 7305085622668206080. Current Snapshot: MvccSnapshot[applied={T|T < 7305085623274737664}]
23:49:29.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.770943 14929 mvcc.cc:204] Tried to move back new op lower bound from 7305085623274737664 to 7305085622668206080. Current Snapshot: MvccSnapshot[applied={T|T < 7305085623274737664}]
23:49:29.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.781018 14928 mvcc.cc:204] Tried to move back new op lower bound from 7305085623274737664 to 7305085622668206080. Current Snapshot: MvccSnapshot[applied={T|T < 7305085623274737664}]
23:49:29.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:29.873 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:29.874 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:29.875 [DEBUG - main] (Connection.java:748) [peer master-127.13.200.190:46423(127.13.200.190:46423)] connecting to peer
23:49:29.876 [DEBUG - main] (Connection.java:748) [peer master-127.13.200.189:33373(127.13.200.189:33373)] connecting to peer
23:49:29.877 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.200.190:46423(127.13.200.190:46423)] Successfully connected to peer
23:49:29.879 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.190
23:49:29.879 [DEBUG - main] (Connection.java:748) [peer master-127.13.200.188:37429(127.13.200.188:37429)] connecting to peer
23:49:29.880 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.200.189:33373(127.13.200.189:33373)] Successfully connected to peer
23:49:29.882 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.189
23:49:29.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468169888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:29.889 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.200.188:37429(127.13.200.188:37429)] Successfully connected to peer
23:49:29.893 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.899 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6ac26cf8, L:/127.0.0.1:55766 - R:/127.13.200.190:46423] using SASL/PLAIN
23:49:29.899 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:29.900 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
23:49:29.902 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:29.902 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=27), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.190:46423, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.189:33373, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.188:37429, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.190:46423: OK, deferred=null) after lookup
23:49:29.903 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa09c3fbd, L:/127.0.0.1:35520 - R:/127.13.200.189:33373] using SASL/PLAIN
23:49:29.905 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.188
23:49:29.909 [DEBUG - main] (Connection.java:748) [peer master-127.13.20.61:45687(127.13.20.61:45687)] connecting to peer
23:49:29.909 [DEBUG - main] (Connection.java:748) [peer master-127.13.20.62:35095(127.13.20.62:35095)] connecting to peer
23:49:29.910 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.20.61:45687(127.13.20.61:45687)] Successfully connected to peer
23:49:29.913 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.916 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xda48bf37, L:/127.0.0.1:55714 - R:/127.13.200.188:37429] using SASL/PLAIN
23:49:29.919 [DEBUG - main] (Connection.java:748) [peer master-127.13.20.60:44081(127.13.20.60:44081)] connecting to peer
23:49:29.920 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.61
23:49:29.920 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.20.62:35095(127.13.20.62:35095)] Successfully connected to peer
23:49:29.921 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.62
23:49:29.923 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.20.60:44081(127.13.20.60:44081)] Successfully connected to peer
23:49:29.928 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.929 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.930 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x01bc0ccb, L:/127.0.0.1:48966 - R:/127.13.20.62:35095] using SASL/PLAIN
23:49:29.934 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xed93ee37, L:/127.0.0.1:36892 - R:/127.13.20.61:45687] using SASL/PLAIN
23:49:29.939 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.60
23:49:29.948 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:29.951 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe60ed22f, L:/127.0.0.1:39700 - R:/127.13.20.60:44081] using SASL/PLAIN
23:49:29.954 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:29.954 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=45), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.61:45687, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.62:35095, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.60:44081, [23ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.62:35095: OK, [27ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.61:45687: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.60:44081: OK, deferred=null) after lookup
23:49:29.956 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bfb5c8aacb224daf932941283bbed429
23:49:29.959 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7585754decfe4ef685de7df84711d164 for table 'replication_test_table' with partition [<start>, <end>)
23:49:29.959 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7585754decfe4ef685de7df84711d164@[2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797),a1a509248df44364b082f3958d577ee7(127.13.20.1:46877),e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)[L]]}]
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:29.961613 14210 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55766:
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
23:49:29.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\000\000\000\007\000\000\000\000"
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:49:29.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:49:29.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
23:49:29.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:29.964649 14210 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:49:29.980 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c4b00a34e6633561fb08795709e8dcd8) switched from state RESTARTING to RUNNING.
23:49:29.981 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job c4b00a34e6633561fb08795709e8dcd8 from Checkpoint 66 @ 1783468168557 for c4b00a34e6633561fb08795709e8dcd8 located at file:/tmp/junit13228762994663478689/checkpoints/c4b00a34e6633561fb08795709e8dcd8/chk-66.
23:49:29.982 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
23:49:29.982 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
23:49:29.992 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
23:49:29.994 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
23:49:29.994 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id d22e0e336504f89f4dee7648ad4e716f
23:49:29.994 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
23:49:29.994 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
23:49:29.995 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d22e0e336504f89f4dee7648ad4e716f.
23:49:29.997 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id d22e0e336504f89f4dee7648ad4e716f.
23:49:30.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.002 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
23:49:30.003 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
23:49:30.003 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id 217be37037a0ec46e05638b03f7dedae
23:49:30.003 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 217be37037a0ec46e05638b03f7dedae.
23:49:30.004 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
23:49:30.004 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
23:49:30.005 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7fc13a58
23:49:30.005 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:30.005 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 217be37037a0ec46e05638b03f7dedae.
23:49:30.005 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:49:30.005 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:49:30.005 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
23:49:30.006 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
23:49:30.011 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
23:49:30.011 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id f9be20d5fda284e3ee0400cc3a3209bc
23:49:30.012 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
23:49:30.012 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c4b00a34e6633561fb08795709e8dcd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:30.016 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
23:49:30.016 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to ede5d2ba-0d1b-4601-ac64-b35863f2b4b5 @ 127.0.0.1 (dataPort=-1) with allocation id c173001062ddee40ff21366b0827dffd
23:49:30.016 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
23:49:30.022 [INFO - Thread-53] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
23:49:30.022 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.9.73.189:33103(127.9.73.189:33103)] disconnecting while in state TERMINATED
23:49:30.023 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@dead93f
23:49:30.024 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.9.73.188:35043(127.9.73.188:35043)] disconnecting while in state TERMINATED
23:49:30.026 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.9.73.190:40177(127.9.73.190:40177)] disconnecting while in state TERMINATED
23:49:30.026 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:30.027 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:49:30.027 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
23:49:30.027 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
23:49:30.028 [INFO - Thread-53] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
23:49:30.028 [INFO - Thread-53] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
23:49:30.029 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:30.030 [DEBUG - Thread-53] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:30.030 [INFO - Thread-53] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:49:30.031 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f9be20d5fda284e3ee0400cc3a3209bc.
23:49:30.032 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id f9be20d5fda284e3ee0400cc3a3209bc.
23:49:30.034 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.034 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
23:49:30.034 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
23:49:30.035 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@157e41d9
23:49:30.035 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:30.035 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:49:30.036 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:49:30.036 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
23:49:30.038 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.040 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:30.040 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:30.040 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:30.040 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
23:49:30.052 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c173001062ddee40ff21366b0827dffd.
23:49:30.053 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id c173001062ddee40ff21366b0827dffd.
23:49:30.054 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
23:49:30.054 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
23:49:30.056 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@76a7cf8a
23:49:30.062 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@556d3d47
23:49:30.062 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:30.063 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:49:30.063 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.063 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:49:30.063 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
23:49:30.064 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.064 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.065 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.065 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.066 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.066 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.066666 14656 tablet_service.cc:1511] Processing CreateTablet for tablet a3023047b2554a0caa55efe6498529d8 (DEFAULT_TABLE table=replication_test_table [id=59ffef4915aa4c0b83f4e007434f8e13]), partition=RANGE (int8) PARTITION UNBOUNDED
23:49:30.068 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@710fa045
23:49:30.070 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:30.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.070645 14656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3023047b2554a0caa55efe6498529d8. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:30.071 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:30.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.083 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.083 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.083 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.097 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:30.100 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.103 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
23:49:30.104 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
23:49:30.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.104136 14514 tablet_service.cc:1511] Processing CreateTablet for tablet a3023047b2554a0caa55efe6498529d8 (DEFAULT_TABLE table=replication_test_table [id=59ffef4915aa4c0b83f4e007434f8e13]), partition=RANGE (int8) PARTITION UNBOUNDED
23:49:30.105 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@73bf13c3
23:49:30.105 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:30.105 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13228762994663478689/checkpoints")
23:49:30.106 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:49:30.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.105799 14514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3023047b2554a0caa55efe6498529d8. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:30.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.105288 14813 tablet_service.cc:1511] Processing CreateTablet for tablet a3023047b2554a0caa55efe6498529d8 (DEFAULT_TABLE table=replication_test_table [id=59ffef4915aa4c0b83f4e007434f8e13]), partition=RANGE (int8) PARTITION UNBOUNDED
23:49:30.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.106703 14813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3023047b2554a0caa55efe6498529d8. 1 dirs total, 0 dirs full, 0 dirs failed
23:49:30.110 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (a47ffb62f668cc7507ba254065e63851_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
23:49:30.115 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7c5b2996
23:49:30.120 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:30.123 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.128886 14879 heartbeater.cc:499] Master 127.13.200.190:46423 was elected leader, sending a full tablet report...
23:49:30.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.129530 14981 tablet_bootstrap.cc:492] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: Bootstrap starting.
23:49:30.131 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.139 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.140571 14981 tablet_bootstrap.cc:654] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: Neither blocks nor log segments found. Creating new log.
23:49:30.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.142586 14982 tablet_bootstrap.cc:492] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: Bootstrap starting.
23:49:30.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.142560 14981 log.cc:826] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: Log is configured to *not* fsync() on all Append() calls
23:49:30.143 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.144 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.144 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.145 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.147 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.150 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.151499 14985 tablet_bootstrap.cc:492] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: Bootstrap starting.
23:49:30.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.153509 14981 tablet_bootstrap.cc:492] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: No bootstrap required, opened a new log
23:49:30.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.153836 14982 tablet_bootstrap.cc:654] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: Neither blocks nor log segments found. Creating new log.
23:49:30.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.154146 14981 ts_tablet_manager.cc:1403] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.009s
23:49:30.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.155436 14982 log.cc:826] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: Log is configured to *not* fsync() on all Append() calls
23:49:30.159 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.159531 14985 tablet_bootstrap.cc:654] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: Neither blocks nor log segments found. Creating new log.
23:49:30.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.160984 14985 log.cc:826] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: Log is configured to *not* fsync() on all Append() calls
23:49:30.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.162477 14982 tablet_bootstrap.cc:492] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: No bootstrap required, opened a new log
23:49:30.163 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.162973 14982 ts_tablet_manager.cc:1403] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.003s
23:49:30.164 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.164 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.165 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.167 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.167 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.167 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.168 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.170090 14981 raft_consensus.cc:359] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.170928 14981 raft_consensus.cc:385] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:30.171 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.171136 14981 raft_consensus.cc:740] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33df8878c6574ef9a87d780861828aea, State: Initialized, Role: FOLLOWER
23:49:30.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.172583 14981 consensus_queue.cc:260] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.173 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.174 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.174 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.174 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.179930 14982 raft_consensus.cc:359] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.180408 14982 raft_consensus.cc:385] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:30.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.180511 14982 raft_consensus.cc:740] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aefe2d10642e44bc9221ed478fff1f6b, State: Initialized, Role: FOLLOWER
23:49:30.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.181416 14982 consensus_queue.cc:260] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.184 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.186 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.185 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.186 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.186 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.187 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.187 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.187 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.187 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.188 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.193461 14985 tablet_bootstrap.cc:492] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: No bootstrap required, opened a new log
23:49:30.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.193922 14985 ts_tablet_manager.cc:1403] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.009s
23:49:30.200 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.201 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.201 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.201 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.201 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.201 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.201 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.202 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.202 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.202 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.202 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.195914 14982 ts_tablet_manager.cc:1434] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: Time spent starting tablet: real 0.033s	user 0.017s	sys 0.001s
23:49:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.198299 14981 ts_tablet_manager.cc:1434] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.006s
23:49:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.210682 14985 raft_consensus.cc:359] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.212356 14985 raft_consensus.cc:385] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:49:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.212478 14985 raft_consensus.cc:740] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691737a8ad6d4a0db0e0fe466798ada0, State: Initialized, Role: FOLLOWER
23:49:30.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.213399 14985 consensus_queue.cc:260] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.217 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.218 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.219 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.219 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.219 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.219 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.219 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.219 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.219 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.219 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.219 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.219 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.219 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.220 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.220 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.220 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.220 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.220 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.220 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.220 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.220 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.220 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.221 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.222 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.222 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.222 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.222 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.222 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.223 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.224 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.224268 14985 ts_tablet_manager.cc:1434] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.003s
23:49:30.224 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.227 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.228 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:30.228825 14588 tablet.cc:2406] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:30.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.229 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.229 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.229 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.229 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.229 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.230 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.230 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.231 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.231 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.231 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.231 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.231 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.232 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.232 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.232 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.232 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.232 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.233 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.233 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.233 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.233 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.233 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.233 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.233 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.234 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:30.234 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:30.234 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:30.234 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:30.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:30.235 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:30.235 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:30.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:30.235 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:30.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:30.235 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:30.235 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:30.235 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:30.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.236503 14997 raft_consensus.cc:493] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:49:30.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.236819 14997 raft_consensus.cc:515] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.239 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.239 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.239 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.239 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.239 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.239 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.239 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.239152 14997 leader_election.cc:290] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691737a8ad6d4a0db0e0fe466798ada0 (127.13.200.129:45157), aefe2d10642e44bc9221ed478fff1f6b (127.13.200.131:45981)
23:49:30.240 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.240 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.240 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.240 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.241 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.243 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.243 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.244 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.251 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.251 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.251 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.252 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.252 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.252 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.252 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.253 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.253 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.253 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.255 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.256 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.256 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.256 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.260 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.260 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.260 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.260 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.265 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.264906 14535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3023047b2554a0caa55efe6498529d8" candidate_uuid: "33df8878c6574ef9a87d780861828aea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691737a8ad6d4a0db0e0fe466798ada0" is_pre_election: true
23:49:30.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.265522 14535 raft_consensus.cc:2468] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33df8878c6574ef9a87d780861828aea in term 0.
23:49:30.266 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.266 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.266476 14608 leader_election.cc:304] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33df8878c6574ef9a87d780861828aea, 691737a8ad6d4a0db0e0fe466798ada0; no voters: 
23:49:30.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.267125 14997 raft_consensus.cc:2804] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Leader pre-election won for term 1
23:49:30.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.267282 14997 raft_consensus.cc:493] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:49:30.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.267414 14997 raft_consensus.cc:3060] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 0 FOLLOWER]: Advancing to term 1
23:49:30.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.270104 14997 raft_consensus.cc:515] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.271 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.271 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.271 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.272 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.272 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.272 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.272 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.272 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.272 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.273 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.273325 14833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3023047b2554a0caa55efe6498529d8" candidate_uuid: "33df8878c6574ef9a87d780861828aea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aefe2d10642e44bc9221ed478fff1f6b" is_pre_election: true
23:49:30.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.273763 14535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3023047b2554a0caa55efe6498529d8" candidate_uuid: "33df8878c6574ef9a87d780861828aea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691737a8ad6d4a0db0e0fe466798ada0"
23:49:30.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.273967 14833 raft_consensus.cc:2468] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33df8878c6574ef9a87d780861828aea in term 0.
23:49:30.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.274103 14535 raft_consensus.cc:3060] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [term 0 FOLLOWER]: Advancing to term 1
23:49:30.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.273305 14832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3023047b2554a0caa55efe6498529d8" candidate_uuid: "33df8878c6574ef9a87d780861828aea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aefe2d10642e44bc9221ed478fff1f6b"
23:49:30.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.274677 14832 raft_consensus.cc:3060] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [term 0 FOLLOWER]: Advancing to term 1
23:49:30.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.277020 14535 raft_consensus.cc:2468] T a3023047b2554a0caa55efe6498529d8 P 691737a8ad6d4a0db0e0fe466798ada0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33df8878c6574ef9a87d780861828aea in term 1.
23:49:30.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.270793 14997 leader_election.cc:290] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [CANDIDATE]: Term 1 election: Requested vote from peers 691737a8ad6d4a0db0e0fe466798ada0 (127.13.200.129:45157), aefe2d10642e44bc9221ed478fff1f6b (127.13.200.131:45981)
23:49:30.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.277791 14608 leader_election.cc:304] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33df8878c6574ef9a87d780861828aea, 691737a8ad6d4a0db0e0fe466798ada0; no voters: 
23:49:30.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.278201 14997 raft_consensus.cc:2804] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 1 FOLLOWER]: Leader election won for term 1
23:49:30.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.278416 14832 raft_consensus.cc:2468] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33df8878c6574ef9a87d780861828aea in term 1.
23:49:30.279 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.279 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.279 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.279 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.280 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.280 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.280 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.281 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.281 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.282 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.282 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.282 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.282 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.282 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.284 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:30.284395 14729 tablet.cc:2406] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:30.280 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.284 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.284 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.286 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.286 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.286 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.286 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.287273 14997 raft_consensus.cc:697] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [term 1 LEADER]: Becoming Leader. State: Replica: 33df8878c6574ef9a87d780861828aea, State: Running, Role: LEADER
23:49:30.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.287976 14997 consensus_queue.cc:237] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } }
23:49:30.291 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.291 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.291 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.291 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.292 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.292 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.292 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.292 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.292 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.292 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.293 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.298 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.299 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.299 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.300 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.300 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.298058 14210 catalog_manager.cc:5696] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea reported cstate change: term changed from 0 to 1, leader changed from <none> to 33df8878c6574ef9a87d780861828aea (127.13.200.130). New cstate: current_term: 1 leader_uuid: "33df8878c6574ef9a87d780861828aea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33df8878c6574ef9a87d780861828aea" member_type: VOTER last_known_addr { host: "127.13.200.130" port: 37033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 } health_report { overall_health: UNKNOWN } } }
23:49:30.300 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.300 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.300 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.301 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.301 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.303 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.303 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.303 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.303 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.304 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.304 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.304 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.305 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.305 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.305 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.305 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.305 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.305 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.305 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.307 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.307 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.307 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.307 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.319 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.319 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.320 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.320 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.320 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.320 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.320 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.320 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.321 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:30.321 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:30.321 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:30.321 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.321 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:30.321 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:30.321 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:30.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:30.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:30.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:30.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:30.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:30.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:30.322 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:30.322 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.323 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.323 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.323 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.339 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.340 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.340 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.340 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.340 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.341 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.341 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.341 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.341 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.341 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.341 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.341 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.341 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.341 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.341 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.344 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.344 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.344 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.345 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.345 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.345 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.351 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.351 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.351 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.352 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.352 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.352 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.352 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:30.352250 14881 tablet.cc:2406] T a3023047b2554a0caa55efe6498529d8 P aefe2d10642e44bc9221ed478fff1f6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:49:30.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.353 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.353 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.353 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.359 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.360 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.360 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.360 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.360 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.361 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.361 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.360 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.361 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.361 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.361 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.361 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.361 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.361 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.361 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.364 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.364 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.364 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.364 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.364 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.364 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.364 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.365 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.365 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.365 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.365 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.365 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.377 [DEBUG - main] (Connection.java:575) [peer master-127.13.20.60:44081(127.13.20.60:44081)] disconnecting while in state READY
23:49:30.377 [DEBUG - main] (Connection.java:575) [peer master-127.13.20.62:35095(127.13.20.62:35095)] disconnecting while in state READY
23:49:30.378 [DEBUG - main] (Connection.java:575) [peer master-127.13.20.61:45687(127.13.20.61:45687)] disconnecting while in state READY
23:49:30.378 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.20.61:45687(127.13.20.61:45687)] handling channelInactive
23:49:30.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.20.61:45687(127.13.20.61:45687)] cleaning up while in state READY due to: connection closed
23:49:30.379 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.379 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.380 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.380 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.20.62:35095(127.13.20.62:35095)] handling channelInactive
23:49:30.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.20.62:35095(127.13.20.62:35095)] cleaning up while in state READY due to: connection closed
23:49:30.380 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.380 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.380 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.381 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:30.381 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.381 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.382 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.383 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:49:30.383 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
23:49:30.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.384 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.384 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.20.60:44081(127.13.20.60:44081)] handling channelInactive
23:49:30.384 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.20.60:44081(127.13.20.60:44081)] cleaning up while in state READY due to: connection closed
23:49:30.385 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
23:49:30.385 [DEBUG - main] (Connection.java:575) [peer master-127.13.200.189:33373(127.13.200.189:33373)] disconnecting while in state READY
23:49:30.385 [DEBUG - main] (Connection.java:575) [peer master-127.13.200.190:46423(127.13.200.190:46423)] disconnecting while in state READY
23:49:30.385 [DEBUG - main] (Connection.java:575) [peer master-127.13.200.188:37429(127.13.200.188:37429)] disconnecting while in state READY
23:49:30.385 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.200.188:37429(127.13.200.188:37429)] handling channelInactive
23:49:30.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.200.188:37429(127.13.200.188:37429)] cleaning up while in state READY due to: connection closed
23:49:30.385 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.200.190:46423(127.13.200.190:46423)] handling channelInactive
23:49:30.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:30.386 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.200.190:46423(127.13.200.190:46423)] cleaning up while in state READY due to: connection closed
23:49:30.388 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:30.388 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:30.388 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:30.388 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:30.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468170388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:30.389 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.389 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.389 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.389 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.389 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.389 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.389 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.390 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:30.390 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
23:49:30.398 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.200.189:33373(127.13.200.189:33373)] handling channelInactive
23:49:30.398 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.200.189:33373(127.13.200.189:33373)] cleaning up while in state READY due to: connection closed
23:49:30.398 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
23:49:30.398 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
23:49:30.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
23:49:30.399 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.399 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.400 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.400 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.400 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.400 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.401 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.401 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.401 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.402 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:30.402 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
23:49:30.402 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
23:49:30.403 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:30.403 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:30.403 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
23:49:30.407 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.407 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.407 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.407 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.411 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.412 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.412 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.412 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.412 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.412 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.412 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.412 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.412 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.412 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.412 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.418 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
23:49:30.418 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
23:49:30.418 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
23:49:30.418 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
23:49:30.418 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
23:49:30.418 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
23:49:30.419 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
23:49:30.424 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.424 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.424 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.425 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.425 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.425 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.425 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.425 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.425 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.425 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.425 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.459 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.459 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.460 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.460 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.460 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.460 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.460 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.460 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.460 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.460 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.460 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.460 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.461 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.461 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.461 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.461 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.471 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.472 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.472 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.472 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.472 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.473 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.473 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.473 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.473 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.501 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.524 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.525 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.525 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.525 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.525 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.525 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.526 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.531 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.534 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:30.535 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:30.535 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:30.535 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:30.535 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:30.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:30.535 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:30.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:30.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:30.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:30.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:30.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:30.536 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:30.539 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.539 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.539 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.539 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.539 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.539 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.539 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.540 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.540 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.540 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.540 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.540 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.540 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.540 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.540 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.541 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.541 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.541 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.541 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.541 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.541 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.541 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.541 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.541 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.559 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.560 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.560 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.561 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.561 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.561 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.561 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.566 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.566 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.566 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.627 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
23:49:30.639 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.640 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.640 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.642 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.647 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:30.648 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:30.648 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:30.648 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.648 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.648 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.648 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.648 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:30.685 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
23:49:30.685 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
23:49:30.685 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
23:49:30.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.693239 14997 consensus_queue.cc:1048] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [LEADER]: Connected to new peer: Peer: permanent_uuid: "aefe2d10642e44bc9221ed478fff1f6b" member_type: VOTER last_known_addr { host: "127.13.200.131" port: 45981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:30.696 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:30.696 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:30.696 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:30.696 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:30.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.697 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.697 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:30.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:30.697 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:30.699 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.700 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.700 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.701 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.701 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.701 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:49:30.701 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.701 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.701 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.708 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.708 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.708 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.709 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.709 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.709 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.709 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.711 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.711 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.711 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.711 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.711 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.711 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.712 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.712 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.712 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.712 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:30.720 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:30.721 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:30.721 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:30.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:30.721 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:30.722 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.722 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.722 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:30.722 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:30.735061 14997 consensus_queue.cc:1048] T a3023047b2554a0caa55efe6498529d8 P 33df8878c6574ef9a87d780861828aea [LEADER]: Connected to new peer: Peer: permanent_uuid: "691737a8ad6d4a0db0e0fe466798ada0" member_type: VOTER last_known_addr { host: "127.13.200.129" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:49:30.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:30.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468170888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:30.898 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
23:49:30.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
23:49:30.939 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:30.939 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:30.939 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:30.939 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:30.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.940 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.940 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:30.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:30.940 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.139 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:31.139 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:31.139 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:31.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.141 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.176 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:31.176 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:31.176 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:31.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.176 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.176 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.176 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.177 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.177 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:31.219 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:31.219 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:31.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:31.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.220 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.220 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.256 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:31.256 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:31.257 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:31.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:31.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:31.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:31.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:31.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:31.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:31.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:31.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:31.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:31.258 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:31.265 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:31.266 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:31.266 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:31.266 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.266 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.267 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.300 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:31.300 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:31.300 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:31.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:31.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:31.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:31.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:31.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:31.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:31.301 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:31.301 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:31.301 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:31.301 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:31.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468171388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:31.400 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:31.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
23:49:31.421 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:31.421 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:31.421 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:31.422 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.422 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.422 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.422 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.422 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.422 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.423 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:31.431 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:49:31.441 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:31.441 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:31.441 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:31.442 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.442 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.442 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.442 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.442 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:31.500 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.555 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.577 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:31.577 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:31.578 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:31.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.578 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.578 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.578 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.578 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.579 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.579 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.579 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:31.580 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:31.581 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:31.581 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:31.581 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.581 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.581 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:31.581 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.581 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.581 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:31.582 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.582 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.582 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:31.582 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:31.599 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:31.599 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:31.599 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:31.600 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:31.600 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:31.600 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:31.600 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:31.600 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:31.600 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:31.600 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:31.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:31.600 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:31.601 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:31.620 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:31.620 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:31.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.621 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:31.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.622 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.622 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.651 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
23:49:31.651 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:31.652 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:31.652 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:31.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.653 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.667 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
23:49:31.679 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:31.680 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:31.680 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:31.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:31.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:31.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:31.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:31.680 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:31.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:31.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:31.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:31.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:31.681 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:31.693 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
23:49:31.709 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
23:49:31.727 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
23:49:31.733 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
23:49:31.734 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
23:49:31.734 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
23:49:31.735 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
23:49:31.735 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
23:49:31.735 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
23:49:31.735 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
23:49:31.736 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:49:31.736 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:49:31.737 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:49:31.737 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:49:31.737 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:49:31.737 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:49:31.737 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
23:49:31.737 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
23:49:31.737 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
23:49:31.737 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
23:49:31.738 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
23:49:31.738 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
23:49:31.738 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
23:49:31.738 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
23:49:31.739 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
23:49:31.739 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
23:49:31.739 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
23:49:31.739 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_c48ab93f15a60bb0033bfaf95e36336a/blobStorage
23:49:31.740 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:34215 - max concurrent requests: 50 - max backlog: 1000
23:49:31.740 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_c48ab93f15a60bb0033bfaf95e36336a/blobStorage
23:49:31.741 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_c48ab93f15a60bb0033bfaf95e36336a/blobStorage
23:49:31.742 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
23:49:31.742 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 970f92cf-edae-44c5-9adf-da409e5133bd
23:49:31.744 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 35 GB (72.92% usable)
23:49:31.744 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-ffcca8d1-7b35-4fed-a278-ffa44c359fdf
23:49:31.746 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-871b1c5e-9646-463c-8acf-82589e20410d
23:49:31.809 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
23:49:31.809 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
23:49:31.809 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
23:49:31.809 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
23:49:31.810 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
23:49:31.812 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_24 .
23:49:31.818 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
23:49:31.819 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-72e7991b-b5d9-43ee-82b8-7b1512a9f8e1
23:49:31.819 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
23:49:31.820 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
23:49:31.829 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
23:49:31.830 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
23:49:31.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.839 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:41985
23:49:31.840 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
23:49:31.848 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
23:49:31.849 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
23:49:31.849 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
23:49:31.849 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 79f4c9a3-a6cf-473c-adbd-edc373b53491. Creating new DispatcherLeaderProcess.
23:49:31.849 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:41985 was granted leadership with leaderSessionID=e74b878a-9715-4418-900e-b7ec95cff820
23:49:31.849 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:41985 , session=e74b878a-9715-4418-900e-b7ec95cff820
23:49:31.849 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
23:49:31.854 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
23:49:31.854 [INFO - mini-cluster-io-thread-2] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
23:49:31.854 [INFO - mini-cluster-io-thread-2] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
23:49:31.856 [INFO - pool-321-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 74f9e6ba-f2ad-4565-a471-11a2b32bb29d.
23:49:31.858 [INFO - mini-cluster-io-thread-2] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_25 .
23:49:31.860 [INFO - pool-321-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_26 .
23:49:31.866 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
23:49:31.866 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
23:49:31.867 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
23:49:31.867 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
23:49:31.867 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
23:49:31.867 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_26 , session=74f9e6ba-f2ad-4565-a471-11a2b32bb29d
23:49:31.876 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(a47111a2b32bb29d74f9e6baf2ad4565).
23:49:31.887 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_25 , session=79f4c9a3-a6cf-473c-adbd-edc373b53491
23:49:31.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468171888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:31.906 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
23:49:31.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
23:49:31.915 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:49:31.919 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:31.919 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:31.920 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:31.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:31.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.920 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.920 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:31.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:31.920 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:31.922 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (2f60d89f2ad64c6df931fae26fa623f3).
23:49:31.923 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (2f60d89f2ad64c6df931fae26fa623f3).
23:49:31.923 [INFO - flink-pekko.actor.default-dispatcher-5] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-2f60d89f2ad64c6df931fae26fa623f3'.
23:49:31.924 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 2f60d89f2ad64c6df931fae26fa623f3 was granted leadership with leader id 576a7c70-3289-4223-889d-34065dc20573. Creating new JobMasterServiceProcess.
23:49:31.926 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1080) Registering TaskManager with ResourceID 970f92cf-edae-44c5-9adf-da409e5133bd (pekko://flink/user/rpc/taskmanager_24) at ResourceManager
23:49:31.926 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_27 .
23:49:31.927 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_26 under registration id 5dd4b2156e7e9b7ebea1c62ade879bdb.
23:49:31.928 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:344) Registering task executor 970f92cf-edae-44c5-9adf-da409e5133bd under 5dd4b2156e7e9b7ebea1c62ade879bdb at the slot manager.
23:49:31.933 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (2f60d89f2ad64c6df931fae26fa623f3).
23:49:31.934 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (2f60d89f2ad64c6df931fae26fa623f3).
23:49:31.934 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 566d3c49a0b9898667647dbd6d01cfa7 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:31.935 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (2f60d89f2ad64c6df931fae26fa623f3).
23:49:31.935 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
23:49:31.936 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
23:49:31.936 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35cee5ca
23:49:31.936 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:31.936 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12336147159927677736/checkpoints")
23:49:31.938 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
23:49:31.938 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@2994a26c for Flink Streaming Job (2f60d89f2ad64c6df931fae26fa623f3).
23:49:31.939 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_27 , session=576a7c70-3289-4223-889d-34065dc20573
23:49:31.940 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (2f60d89f2ad64c6df931fae26fa623f3) under job master id 889d34065dc20573576a7c7032894223.
23:49:31.940 [INFO - flink-pekko.actor.default-dispatcher-9] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
23:49:31.942 [DEBUG - flink-pekko.actor.default-dispatcher-9] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:31.943 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
23:49:31.943 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f60d89f2ad64c6df931fae26fa623f3) switched from state CREATED to RUNNING.
23:49:31.944 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
23:49:31.944 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
23:49:31.944 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.20.61:45687(127.13.20.61:45687)] connecting to peer
23:49:31.944 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
23:49:31.945 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
23:49:31.945 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.20.62:35095(127.13.20.62:35095)] connecting to peer
23:49:31.945 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.13.20.60:44081(127.13.20.60:44081)] connecting to peer
23:49:31.946 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(a47111a2b32bb29d74f9e6baf2ad4565)
23:49:31.946 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.20.61:45687(127.13.20.61:45687)] Successfully connected to peer
23:49:31.947 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
23:49:31.948 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager 889d34065dc20573576a7c7032894223@pekko://flink/user/rpc/jobmanager_27 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:31.955 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager 889d34065dc20573576a7c7032894223@pekko://flink/user/rpc/jobmanager_27 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:31.961 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.20.62:35095(127.13.20.62:35095)] Successfully connected to peer
23:49:31.964 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.61
23:49:31.965 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.62
23:49:31.966 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.20.60:44081(127.13.20.60:44081)] Successfully connected to peer
23:49:31.977 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:31.977 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:31.979 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a47111a2b32bb29d74f9e6baf2ad4565.
23:49:31.980 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f60d89f2ad64c6df931fae26fa623f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
23:49:31.982 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7431c246, L:/127.0.0.1:48968 - R:/127.13.20.62:35095] using SASL/PLAIN
23:49:31.983 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4ec46b39, L:/127.0.0.1:36896 - R:/127.13.20.61:45687] using SASL/PLAIN
23:49:31.985 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.60
23:49:31.985 [DEBUG - main] (Connection.java:748) [peer master-127.13.200.190:46423(127.13.200.190:46423)] connecting to peer
23:49:31.986 [DEBUG - main] (Connection.java:748) [peer master-127.13.200.189:33373(127.13.200.189:33373)] connecting to peer
23:49:31.987 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.200.190:46423(127.13.200.190:46423)] Successfully connected to peer
23:49:31.989 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.190
23:49:31.991 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f60d89f2ad64c6df931fae26fa623f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 2f60d89f2ad64c6df931fae26fa623f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:31.995 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 2f60d89f2ad64c6df931fae26fa623f3
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 970f92cf-edae-44c5-9adf-da409e5133bd
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
23:49:31.996 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f65b6129a833f55325f45ff48ab7f8fa from 970f92cf-edae-44c5-9adf-da409e5133bd for job 2f60d89f2ad64c6df931fae26fa623f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:31.996 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 3360824ac01e94e4e3aea54887e8ff0a from 970f92cf-edae-44c5-9adf-da409e5133bd for job 2f60d89f2ad64c6df931fae26fa623f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:31.997 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 053a81319deb40fd27ceb4d5b751acc8 from 970f92cf-edae-44c5-9adf-da409e5133bd for job 2f60d89f2ad64c6df931fae26fa623f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:31.997 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 9a697f55b69a83b348ea76632d8b05f3 from 970f92cf-edae-44c5-9adf-da409e5133bd for job 2f60d89f2ad64c6df931fae26fa623f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:31.998 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request f65b6129a833f55325f45ff48ab7f8fa for job 2f60d89f2ad64c6df931fae26fa623f3 from resource manager with leader id a47111a2b32bb29d74f9e6baf2ad4565.
23:49:31.999 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for f65b6129a833f55325f45ff48ab7f8fa with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:31.999 [DEBUG - main] (Connection.java:748) [peer master-127.13.200.188:37429(127.13.200.188:37429)] connecting to peer
23:49:32.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.001 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.003 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9d78a314, L:/127.0.0.1:39702 - R:/127.13.20.60:44081] using SASL/PLAIN
23:49:32.004 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.200.189:33373(127.13.200.189:33373)] Successfully connected to peer
23:49:32.006 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:32.007 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=62), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.61:45687, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.62:35095, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.20.60:44081, [40ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.62:35095: OK, [48ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.61:45687: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.20.60:44081: OK, deferred=null) after lookup
23:49:32.009 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.010 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bfb5c8aacb224daf932941283bbed429
23:49:32.012 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfdc65027, L:/127.0.0.1:55774 - R:/127.13.200.190:46423] using SASL/PLAIN
23:49:32.014 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7585754decfe4ef685de7df84711d164 for table 'replication_test_table' with partition [<start>, <end>)
23:49:32.015 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7585754decfe4ef685de7df84711d164@[2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797),a1a509248df44364b082f3958d577ee7(127.13.20.1:46877),e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)[L]]}]
23:49:32.021 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:32.021 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=43), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.190:46423, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.189:33373, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.188:37429, [29ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.190:46423: OK, deferred=null) after lookup
23:49:32.022 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.200.188:37429(127.13.200.188:37429)] Successfully connected to peer
23:49:32.024 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.189
23:49:32.027 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.031 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 2f60d89f2ad64c6df931fae26fa623f3 for job leader monitoring.
23:49:32.032 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 3360824ac01e94e4e3aea54887e8ff0a for job 2f60d89f2ad64c6df931fae26fa623f3 from resource manager with leader id a47111a2b32bb29d74f9e6baf2ad4565.
23:49:32.032 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 3360824ac01e94e4e3aea54887e8ff0a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:32.032 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 053a81319deb40fd27ceb4d5b751acc8 for job 2f60d89f2ad64c6df931fae26fa623f3 from resource manager with leader id a47111a2b32bb29d74f9e6baf2ad4565.
23:49:32.032 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 053a81319deb40fd27ceb4d5b751acc8 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:32.032 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_27 with leader id 576a7c70-3289-4223-889d-34065dc20573.
23:49:32.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.034 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
23:49:32.034 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:32.035 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:32.035 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:32.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.036 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.036 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.036 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:32.037 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.032 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 9a697f55b69a83b348ea76632d8b05f3 for job 2f60d89f2ad64c6df931fae26fa623f3 from resource manager with leader id a47111a2b32bb29d74f9e6baf2ad4565.
23:49:32.038 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 9a697f55b69a83b348ea76632d8b05f3 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
23:49:32.038 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a3023047b2554a0caa55efe6498529d8 for table 'replication_test_table' with partition [<start>, <end>)
23:49:32.038 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a3023047b2554a0caa55efe6498529d8@[33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)[L],691737a8ad6d4a0db0e0fe466798ada0(127.13.200.129:45157),aefe2d10642e44bc9221ed478fff1f6b(127.13.200.131:45981)]}]
23:49:32.038 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.13.200.190:46423, [10ms] Sub RPC GetTableLocations: received response from server master-127.13.200.190:46423: OK, deferred=null)) after lookup
23:49:32.039 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] connecting to peer
23:49:32.039 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_27 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:32.039 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:32.040 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:32.041 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
23:49:32.042 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 970f92cf-edae-44c5-9adf-da409e5133bd @ 127.0.0.1 (dataPort=-1) with allocation id 3360824ac01e94e4e3aea54887e8ff0a
23:49:32.043 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3360824ac01e94e4e3aea54887e8ff0a.
23:49:32.043 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:32.044 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:32.044 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:32.044 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:32.044 [INFO - flink-pekko.actor.default-dispatcher-7] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
23:49:32.044 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.044 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.044 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 2f60d89f2ad64c6df931fae26fa623f3
23:49:32.044 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.045 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 3360824ac01e94e4e3aea54887e8ff0a.
23:49:32.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.045 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:32.048 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9c6ce171, L:/127.0.0.1:35530 - R:/127.13.200.189:33373] using SASL/PLAIN
23:49:32.051 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.053 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] Successfully connected to peer
23:49:32.056 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x50c6354b, L:/127.0.0.1:55718 - R:/127.13.200.188:37429] using TOKEN/null
23:49:32.060 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
23:49:32.060 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 970f92cf-edae-44c5-9adf-da409e5133bd @ 127.0.0.1 (dataPort=-1) with allocation id 9a697f55b69a83b348ea76632d8b05f3
23:49:32.061 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
23:49:32.061 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 970f92cf-edae-44c5-9adf-da409e5133bd @ 127.0.0.1 (dataPort=-1) with allocation id f65b6129a833f55325f45ff48ab7f8fa
23:49:32.065 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.069 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x688c9c3a, L:/127.0.0.1:45246 - R:/127.13.200.130:37033] using TOKEN/null
23:49:32.069 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
23:49:32.069 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 970f92cf-edae-44c5-9adf-da409e5133bd @ 127.0.0.1 (dataPort=-1) with allocation id 053a81319deb40fd27ceb4d5b751acc8
23:49:32.071 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9a697f55b69a83b348ea76632d8b05f3.
23:49:32.073 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 9a697f55b69a83b348ea76632d8b05f3.
23:49:32.075 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
23:49:32.075 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
23:49:32.078 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f65b6129a833f55325f45ff48ab7f8fa.
23:49:32.081 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.081 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id f65b6129a833f55325f45ff48ab7f8fa.
23:49:32.082 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
23:49:32.082 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
23:49:32.083 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@26e216a5
23:49:32.083 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5291d97e
23:49:32.083 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:32.083 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12336147159927677736/checkpoints")
23:49:32.085 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:49:32.086 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
23:49:32.088 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 3360824ac01e94e4e3aea54887e8ff0a.
23:49:32.088 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9a697f55b69a83b348ea76632d8b05f3.
23:49:32.088 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f65b6129a833f55325f45ff48ab7f8fa.
23:49:32.088 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 053a81319deb40fd27ceb4d5b751acc8.
23:49:32.088 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 053a81319deb40fd27ceb4d5b751acc8.
23:49:32.092 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:32.092 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12336147159927677736/checkpoints")
23:49:32.092 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:49:32.093 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
23:49:32.096 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 053a81319deb40fd27ceb4d5b751acc8.
23:49:32.098 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
23:49:32.098 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
23:49:32.098 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b4d0aab
23:49:32.099 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@71a405bf
23:49:32.099 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:32.099 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12336147159927677736/checkpoints")
23:49:32.101 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:49:32.101 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
23:49:32.100 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4bbb6b92
23:49:32.110 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@324be33
23:49:32.111 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:32.112 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
23:49:32.112 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
23:49:32.112 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:32.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@572da507
23:49:32.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
23:49:32.115 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12336147159927677736/checkpoints")
23:49:32.116 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:49:32.116 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
23:49:32.119 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:32.120 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.13.200.190:46423(127.13.200.190:46423)] connecting to peer
23:49:32.122 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@769c8a4f
23:49:32.128 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.13.200.190:46423(127.13.200.190:46423)] connecting to peer
23:49:32.137 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.139 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.13.200.190:46423(127.13.200.190:46423)] connecting to peer
23:49:32.144 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:32.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.155 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.13.200.189:33373(127.13.200.189:33373)] connecting to peer
23:49:32.156 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.200.190:46423(127.13.200.190:46423)] Successfully connected to peer
23:49:32.157 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.13.200.188:37429(127.13.200.188:37429)] connecting to peer
23:49:32.157 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.13.200.189:33373(127.13.200.189:33373)] connecting to peer
23:49:32.158 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.190
23:49:32.163 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.200.189:33373(127.13.200.189:33373)] Successfully connected to peer
23:49:32.165 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.189
23:49:32.166 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.200.190:46423(127.13.200.190:46423)] Successfully connected to peer
23:49:32.168 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.200.188:37429(127.13.200.188:37429)] Successfully connected to peer
23:49:32.173 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.188
23:49:32.176 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.180 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.13.200.189:33373(127.13.200.189:33373)] connecting to peer
23:49:32.181 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.200.190:46423(127.13.200.190:46423)] Successfully connected to peer
23:49:32.187 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.13.200.188:37429(127.13.200.188:37429)] connecting to peer
23:49:32.188 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4ca34465, L:/127.0.0.1:55788 - R:/127.13.200.190:46423] using SASL/PLAIN
23:49:32.188 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.200.189:33373(127.13.200.189:33373)] Successfully connected to peer
23:49:32.191 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.191 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.190
23:49:32.196 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.198 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.190
23:49:32.199 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:32.199 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=86), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.190:46423, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.189:33373, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.188:37429, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.190:46423: OK, deferred=null) after lookup
23:49:32.205 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.207 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf1b31acc, L:/127.0.0.1:35532 - R:/127.13.200.189:33373] using SASL/PLAIN
23:49:32.208 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.209 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.189
23:49:32.215 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.215 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@23052648
23:49:32.217 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
23:49:32.217 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xac479dab, L:/127.0.0.1:55730 - R:/127.13.200.188:37429] using SASL/PLAIN
23:49:32.221 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.222 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.222 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
23:49:32.224 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x36e74c5d, L:/127.0.0.1:35546 - R:/127.13.200.189:33373] using SASL/PLAIN
23:49:32.226 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x94848ca1, L:/127.0.0.1:55796 - R:/127.13.200.190:46423] using SASL/PLAIN
23:49:32.227 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.13.200.190:46423(127.13.200.190:46423)] connecting to peer
23:49:32.225 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.231 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.13.200.188:37429(127.13.200.188:37429)] connecting to peer
23:49:32.232 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.200.189:33373(127.13.200.189:33373)] Successfully connected to peer
23:49:32.232 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x81c0e828, L:/127.0.0.1:55806 - R:/127.13.200.190:46423] using SASL/PLAIN
23:49:32.239 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:32.239 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=119), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.190:46423, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.189:33373, [91ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.190:46423: OK, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.188:37429, deferred=null) after lookup
23:49:32.240 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.189
23:49:32.252 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.200.188:37429(127.13.200.188:37429)] Successfully connected to peer
23:49:32.253 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:32.254 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:32.254 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:32.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.254 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.254 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.254 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.255 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.255 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:32.259 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.259 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.259 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@335e38cb
23:49:32.260 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
23:49:32.260 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
23:49:32.266 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.267 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:49:32.268 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='973a9be5e909ef8f75e59abd6cceeaf5f151ad10ce66fbabf3916798f4358d6e'}]
23:49:32.275 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdfa59689, L:/127.0.0.1:55738 - R:/127.13.200.188:37429] using TOKEN/null
23:49:32.277 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:32.279 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.281 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:32.281 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:32.281 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:32.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:32.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:32.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:32.282 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:32.282 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:32.282 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:32.282 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:32.282 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:32.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:32.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:32.283 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:32.283 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=169), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.190:46423, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.189:33373, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.188:37429, [97ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.189:33373: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.190:46423: OK, deferred=null) after lookup
23:49:32.285 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.200.188:37429(127.13.200.188:37429)] Successfully connected to peer
23:49:32.285 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.287 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xee77671f, L:/127.0.0.1:35550 - R:/127.13.200.189:33373] using SASL/PLAIN
23:49:32.290 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.290 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@372c149d
23:49:32.292 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.13.200.189:33373(127.13.200.189:33373)] connecting to peer
23:49:32.294 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.200.190:46423(127.13.200.190:46423)] Successfully connected to peer
23:49:32.296 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.13.200.188:37429(127.13.200.188:37429)] connecting to peer
23:49:32.297 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.200.189:33373(127.13.200.189:33373)] Successfully connected to peer
23:49:32.304 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.189
23:49:32.305 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.190
23:49:32.307 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.200.188:37429(127.13.200.188:37429)] Successfully connected to peer
23:49:32.313 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.313 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:49:32.320 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.321 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=7585754decfe4ef685de7df84711d164@[2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797),a1a509248df44364b082f3958d577ee7(127.13.20.1:46877),e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)[L]]}]
23:49:32.323 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb43fab50, L:/127.0.0.1:35556 - R:/127.13.200.189:33373] using SASL/PLAIN
23:49:32.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.335 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.337 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.200.188
23:49:32.343 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfb9a222a, L:/127.0.0.1:55740 - R:/127.13.200.188:37429] using TOKEN/null
23:49:32.346 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.348 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.350 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb24dbe5e, L:/127.0.0.1:55744 - R:/127.13.200.188:37429] using SASL/PLAIN
23:49:32.350 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaebdca6f, L:/127.0.0.1:55820 - R:/127.13.200.190:46423] using SASL/PLAIN
23:49:32.355 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:49:32.357 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:49:32.357 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=212), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.190:46423, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.189:33373, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.200.188:37429, [98ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.189:33373: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.188:37429: OK, [129ms] Sub RPC ConnectToMaster: received response from server master-127.13.200.190:46423: OK, deferred=null) after lookup
23:49:32.358 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
23:49:32.360 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
23:49:32.360 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
23:49:32.366 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.367 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.369 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
23:49:32.369 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:32.369 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b6fd0
23:49:32.371 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
23:49:32.371 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
23:49:32.381 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] connecting to peer
23:49:32.382 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:49:32.387 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] Successfully connected to peer
23:49:32.387 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:49:32.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468172388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:32.400 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:32.400 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:32.400 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:32.400 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:32.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.402 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:32.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
23:49:32.410 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
23:49:32.410 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (566d3c49a0b9898667647dbd6d01cfa7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
23:49:32.414 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.3
23:49:32.421 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.423 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.427 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe3d30eed, L:/127.0.0.1:42646 - R:/127.13.20.3:43797] using SASL/PLAIN
23:49:32.434 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:32.434 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:32.434 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:32.434 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.435 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.435 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.435 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.435 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.435 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.435 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.435 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:32.460 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:32.461 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:32.461 [DEBUG - pool-237-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:32.461 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.461 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.462 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.462 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.462 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.462 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.462 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.462 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.463 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:32.470 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false, responseScanTimestamp = 7305085632282624001) for scanner KuduScanner(table=replication_test_table, tablet=7585754decfe4ef685de7df84711d164, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.471 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [973a9be5e909ef8f75e59abd6cceeaf5f151ad10ce66fbabf3916798f4358d6e]
23:49:32.472 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
23:49:32.479 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.491 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468172490 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:32.498 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=180, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@56cf4e67, flushNotification=Deferred@1744349090(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:32.500 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a3023047b2554a0caa55efe6498529d8 for table 'replication_test_table' with partition [<start>, <end>)
23:49:32.500 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a3023047b2554a0caa55efe6498529d8@[33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)[L],691737a8ad6d4a0db0e0fe466798ada0(127.13.200.129:45157),aefe2d10642e44bc9221ed478fff1f6b(127.13.200.131:45981)]}]
23:49:32.501 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.501 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] connecting to peer
23:49:32.515 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] Successfully connected to peer
23:49:32.527 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:32.531 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.532 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xee89b792, L:/127.0.0.1:45260 - R:/127.13.200.130:37033] using TOKEN/null
23:49:32.535 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.556 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:32.557 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:32.557 [DEBUG - pool-239-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:32.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.557 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.557 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.558 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.558 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.558 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.558 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.558 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:32.591 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:32.592 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:32.592 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:32.592 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.592 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.592 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.592 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:32.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.593 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:32.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:32.593 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:32.595 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.653 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.659 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [973a9be5e909ef8f75e59abd6cceeaf5f151ad10ce66fbabf3916798f4358d6e]
23:49:32.663 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:49:32.663 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 973a9be5e909ef8f75e59abd6cceeaf5f151ad10ce66fbabf3916798f4358d6e finished by subtask 0; deferring removal (restored in pending)
23:49:32.663 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:49:32.664 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] disconnecting while in state READY
23:49:32.665 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:32.666 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 2f60d89f2ad64c6df931fae26fa623f3 (1952 bytes, checkpointDuration=176 ms, finalizationTime=0 ms).
23:49:32.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
23:49:32.668 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 973a9be5e909ef8f75e59abd6cceeaf5f151ad10ce66fbabf3916798f4358d6e from pending
23:49:32.669 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
23:49:32.671 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] handling channelInactive
23:49:32.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] cleaning up while in state READY due to: connection closed
23:49:32.671 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
23:49:32.671 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:49:32.709 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.716 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:32.716 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:32.716 [DEBUG - pool-235-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:32.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.717 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.717 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:32.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:32.718 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.718 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.718 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:32.718 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:32.765 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.819 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:32.874 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.888 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468172888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:32.896 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:32.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
23:49:32.929 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.946 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:32.947 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:32.947 [DEBUG - pool-220-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:32.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:32.948 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.948 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.948 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:32.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:32.948 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:32.984 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:32.991 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468172990 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:32.993 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=9, operationSize=1620, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@329d897c, flushNotification=Deferred@1789886680(state=PENDING, result=null, callback=<none>, errback=<none>)}
23:49:33.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.017 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 2f60d89f2ad64c6df931fae26fa623f3 (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
23:49:33.018 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
23:49:33.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.039 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:33.042 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bfb5c8aacb224daf932941283bbed429
23:49:33.056 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7585754decfe4ef685de7df84711d164, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:33.060 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59ffef4915aa4c0b83f4e007434f8e13
23:49:33.078 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a3023047b2554a0caa55efe6498529d8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:33.080 [DEBUG - main] (Connection.java:575) [peer master-127.13.200.189:33373(127.13.200.189:33373)] disconnecting while in state READY
23:49:33.080 [DEBUG - main] (Connection.java:575) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] disconnecting while in state READY
23:49:33.080 [DEBUG - main] (Connection.java:575) [peer master-127.13.200.190:46423(127.13.200.190:46423)] disconnecting while in state READY
23:49:33.080 [DEBUG - main] (Connection.java:575) [peer master-127.13.200.188:37429(127.13.200.188:37429)] disconnecting while in state READY
23:49:33.081 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.200.189:33373(127.13.200.189:33373)] handling channelInactive
23:49:33.081 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.200.189:33373(127.13.200.189:33373)] cleaning up while in state READY due to: connection closed
23:49:33.082 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.200.190:46423(127.13.200.190:46423)] handling channelInactive
23:49:33.082 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.200.190:46423(127.13.200.190:46423)] cleaning up while in state READY due to: connection closed
23:49:33.082 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.200.188:37429(127.13.200.188:37429)] handling channelInactive
23:49:33.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.200.188:37429(127.13.200.188:37429)] cleaning up while in state READY due to: connection closed
23:49:33.088 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:33.090 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
23:49:33.090 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
23:49:33.091 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
23:49:33.098 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] handling channelInactive
23:49:33.099 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] cleaning up while in state READY due to: connection closed
23:49:33.099 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
23:49:33.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.099314 14114 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 14452
23:49:33.120 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:33.120 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:33.121 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:33.121 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:33.121 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:33.121 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:33.122 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:33.122 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:33.122 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:33.122 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:33.122 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:33.122 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:33.122 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:33.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.147 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.125:36473(127.7.104.125:36473)] connecting to peer
23:49:33.148 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.126:33577(127.7.104.126:33577)] connecting to peer
23:49:33.148 [DEBUG - pool-233-thread-1] (Connection.java:748) [peer master-127.7.104.124:39307(127.7.104.124:39307)] connecting to peer
23:49:33.148 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:33.148 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.104.125:36473(127.7.104.125:36473)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:33.148 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.125:36473: Failed to connect to peer master-127.7.104.125:36473(127.7.104.125:36473): Connection refused: /127.7.104.125:36473
23:49:33.149 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:33.149 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.104.126:33577(127.7.104.126:33577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:33.149 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.126:33577: Failed to connect to peer master-127.7.104.126:33577(127.7.104.126:33577): Connection refused: /127.7.104.126:33577
23:49:33.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:33.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.104.124:39307(127.7.104.124:39307)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:33.150 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.104.124:39307: Failed to connect to peer master-127.7.104.124:39307(127.7.104.124:39307): Connection refused: /127.7.104.124:39307
23:49:33.150 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.104.125:36473,127.7.104.126:33577,127.7.104.124:39307; will retry
23:49:33.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.162359 14575 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:33.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.345722 14114 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 14452
23:49:33.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.376646 14114 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 14587
23:49:33.388 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468173388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:33.397 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:33.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
23:49:33.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.404568 14716 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:33.413 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:33.413 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:33.414 [DEBUG - pool-226-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:33.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:33.414 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:33.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:33.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:33.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:33.414 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:33.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:33.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:33.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:33.414 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:33.490 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468173490 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:33.501 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.501 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 2f60d89f2ad64c6df931fae26fa623f3 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
23:49:33.503 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
23:49:33.531 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.568725 14114 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 14587
23:49:33.572 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.254:41819(127.11.23.254:41819)] connecting to peer
23:49:33.572 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.253:46397(127.11.23.253:46397)] connecting to peer
23:49:33.572 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.11.23.252:40791(127.11.23.252:40791)] connecting to peer
23:49:33.573 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:33.573 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.23.254:41819(127.11.23.254:41819)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:33.573 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.254:41819: Failed to connect to peer master-127.11.23.254:41819(127.11.23.254:41819): Connection refused: /127.11.23.254:41819
23:49:33.574 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:33.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.23.252:40791(127.11.23.252:40791)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:33.574 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.252:40791: Failed to connect to peer master-127.11.23.252:40791(127.11.23.252:40791): Connection refused: /127.11.23.252:40791
23:49:33.574 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:33.574 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.23.253:46397(127.11.23.253:46397)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:33.574 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.23.253:46397: Failed to connect to peer master-127.11.23.253:46397(127.11.23.253:46397): Connection refused: /127.11.23.253:46397
23:49:33.574 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.23.254:41819,127.11.23.253:46397,127.11.23.252:40791; will retry
23:49:33.599 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] handling channelInactive
23:49:33.600 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 33df8878c6574ef9a87d780861828aea(127.13.200.130:37033)] cleaning up while in state READY due to: connection closed
23:49:33.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.600378 14114 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 14725
23:49:33.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.608933 14873 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:33.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.679 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:33.680 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:33.680 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:33.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:33.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:33.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:33.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:33.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:33.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:33.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:33.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:33.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:33.682 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:33.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.716003 14114 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 14725
23:49:33.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.737775 14114 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 14125
23:49:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.739527 14241 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:33.801 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:33.801 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:33.801 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:33.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:33.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:33.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:33.803 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:33.803 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:33.803 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:33.803 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:33.803 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:33.803 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:33.803 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:33.831 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:33.832 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:33.832 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:33.832 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:33.832 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:33.832 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:33.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:33.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:33.832 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:33.833 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:33.833 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:33.833 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:33.833 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:33.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:33.840 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:33.840 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:33.840 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:33.841 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:33.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:33.841 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:33.841 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:33.841 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:33.841 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:33.841 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:33.841 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:33.841 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:33.841 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry
23:49:33.844 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:33.845 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:33.845 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:33.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:33.845 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:33.845 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:33.845 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:33.845 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:33.845 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:33.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:33.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:33.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:33.846 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:33.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.878508 14114 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 14125
23:49:33.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468173888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:33.899 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
23:49:33.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
23:49:33.911 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.200.190:46423(127.13.200.190:46423)] handling channelInactive
23:49:33.911 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.200.190:46423(127.13.200.190:46423)] handling channelInactive
23:49:33.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.200.190:46423(127.13.200.190:46423)] cleaning up while in state READY due to: connection closed
23:49:33.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.200.190:46423(127.13.200.190:46423)] cleaning up while in state READY due to: connection closed
23:49:33.912 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.200.190:46423(127.13.200.190:46423)] handling channelInactive
23:49:33.912 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.200.190:46423(127.13.200.190:46423)] handling channelInactive
23:49:33.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.911876 14114 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 14248
23:49:33.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.200.190:46423(127.13.200.190:46423)] cleaning up while in state READY due to: connection closed
23:49:33.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.200.190:46423(127.13.200.190:46423)] cleaning up while in state READY due to: connection closed
23:49:33.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:33.913372 14313 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:33.946 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table bfb5c8aacb224daf932941283bbed429
23:49:33.948 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ec575de8455b7cd824fa7fe688f9526921048ae898b57d32d42a6a4f995b80ca'}]
23:49:33.949 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
23:49:33.950 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
23:49:33.951 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298066, tablet=7585754decfe4ef685de7df84711d164@[2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797),a1a509248df44364b082f3958d577ee7(127.13.20.1:46877),e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)[L]]}]
23:49:33.952 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] connecting to peer
23:49:33.953 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] Successfully connected to peer
23:49:33.954 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.20.3
23:49:33.961 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
23:49:33.963 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf81dd4ff, L:/127.0.0.1:42656 - R:/127.13.20.3:43797] using SASL/PLAIN
23:49:33.990 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468173990 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:33.998 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 2f60d89f2ad64c6df931fae26fa623f3 (1962 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:34.000 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
23:49:34.000 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.044541 14114 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 14248
23:49:34.055 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:34.055 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:34.055 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:34.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.056 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:34.069 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.200.189:33373(127.13.200.189:33373)] handling channelInactive
23:49:34.069 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.200.189:33373(127.13.200.189:33373)] cleaning up while in state READY due to: connection closed
23:49:34.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.070019 14114 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 14320
23:49:34.070 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.200.189:33373(127.13.200.189:33373)] handling channelInactive
23:49:34.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.200.189:33373(127.13.200.189:33373)] cleaning up while in state READY due to: connection closed
23:49:34.069 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.200.189:33373(127.13.200.189:33373)] handling channelInactive
23:49:34.070 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.200.189:33373(127.13.200.189:33373)] handling channelInactive
23:49:34.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.200.189:33373(127.13.200.189:33373)] cleaning up while in state READY due to: connection closed
23:49:34.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.200.189:33373(127.13.200.189:33373)] cleaning up while in state READY due to: connection closed
23:49:34.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.071419 14385 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:34.145 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.195942 14114 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 14320
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.200.188:37429(127.13.200.188:37429)] handling channelInactive
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.200.188:37429(127.13.200.188:37429)] handling channelInactive
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.200.188:37429(127.13.200.188:37429)] cleaning up while in state READY due to: connection closed
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.200.188:37429(127.13.200.188:37429)] handling channelInactive
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.200.188:37429(127.13.200.188:37429)] cleaning up while in state READY due to: connection closed
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.200.188:37429(127.13.200.188:37429)] handling channelInactive
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.200.188:37429(127.13.200.188:37429)] cleaning up while in state READY due to: connection closed
23:49:34.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.200.188:37429(127.13.200.188:37429)] cleaning up while in state READY due to: connection closed
23:49:34.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:34Z chronyd exiting
23:49:34.254 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:34.254 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:34.254 [DEBUG - pool-222-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:34.254 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.254 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.255 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:34.288 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:34.288 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:34.289 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:34.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:34.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:34.289 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:34.289 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:34.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:34.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:34.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:34.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:34.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:34.289 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:34.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.356 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:34.356 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:34.356 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:34.356 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.356 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.357 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.357 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.357 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.357 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.357 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.357 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.357 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.357 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:34.367 [DEBUG - main] (Connection.java:575) [peer master-127.13.20.60:44081(127.13.20.60:44081)] disconnecting while in state READY
23:49:34.368 [DEBUG - main] (Connection.java:575) [peer master-127.13.20.62:35095(127.13.20.62:35095)] disconnecting while in state READY
23:49:34.368 [DEBUG - main] (Connection.java:575) [peer master-127.13.20.61:45687(127.13.20.61:45687)] disconnecting while in state READY
23:49:34.368 [DEBUG - main] (Connection.java:575) [peer e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)] disconnecting while in state READY
23:49:34.368 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.20.60:44081(127.13.20.60:44081)] handling channelInactive
23:49:34.368 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.20.62:35095(127.13.20.62:35095)] handling channelInactive
23:49:34.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.20.62:35095(127.13.20.62:35095)] cleaning up while in state READY due to: connection closed
23:49:34.369 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.20.60:44081(127.13.20.60:44081)] cleaning up while in state READY due to: connection closed
23:49:34.369 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:34.369 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)] handling channelInactive
23:49:34.369 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e870894e7d424a0b9e3746c78d9e0156(127.13.20.2:33087)] cleaning up while in state READY due to: connection closed
23:49:34.370 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
23:49:34.370 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
23:49:34.370 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
23:49:34.371 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.20.61:45687(127.13.20.61:45687)] handling channelInactive
23:49:34.371 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.20.61:45687(127.13.20.61:45687)] cleaning up while in state READY due to: connection closed
23:49:34.371 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
23:49:34.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.371306 13392 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 13677
23:49:34.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.380762 13800 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:34.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468174388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:34.394 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305085640470528001) for scanner KuduScanner(table=replication_test_table, tablet=7585754decfe4ef685de7df84711d164, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:49:34.394 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [ec575de8455b7cd824fa7fe688f9526921048ae898b57d32d42a6a4f995b80ca]
23:49:34.394 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ec575de8455b7cd824fa7fe688f9526921048ae898b57d32d42a6a4f995b80ca]
23:49:34.395 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
23:49:34.395 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
23:49:34.395 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] disconnecting while in state READY
23:49:34.396 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ec575de8455b7cd824fa7fe688f9526921048ae898b57d32d42a6a4f995b80ca finished by subtask 2; deferring removal (restored in pending)
23:49:34.396 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:49:34.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
23:49:34.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
23:49:34.408 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
23:49:34.408 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] handling channelInactive
23:49:34.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f8ef3cb80cd4033b631ffe32cdb0ee4(127.13.20.3:43797)] cleaning up while in state READY due to: connection closed
23:49:34.408 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
23:49:34.490 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468174490 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:34.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.492086 13392 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 13677
23:49:34.522 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.528 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 2f60d89f2ad64c6df931fae26fa623f3 (1962 bytes, checkpointDuration=37 ms, finalizationTime=0 ms).
23:49:34.529 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
23:49:34.529 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split ec575de8455b7cd824fa7fe688f9526921048ae898b57d32d42a6a4f995b80ca from pending
23:49:34.529 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
23:49:34.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.545763 13392 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 13815
23:49:34.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.561976 13950 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:34.600 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:34.600 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:34.600 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:34.601 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:34.601 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:34.601 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:34.601 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:34.601 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:34.601 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:34.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:34.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:34.602 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:34.602 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:34.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.678 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:34.678 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:34.678 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:34.679 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.679 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.679 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.680 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.680 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.680 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.680 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:34.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.717864 13392 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 13815
23:49:34.721 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:34.721 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:34.721 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:34.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.722 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.722 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.722 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.722 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.722 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:34.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.756062 13392 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 13964
23:49:34.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.764876 14099 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:34.774 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.252:44265(127.4.149.252:44265)] connecting to peer
23:49:34.775 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.253:38083(127.4.149.253:38083)] connecting to peer
23:49:34.775 [DEBUG - pool-224-thread-1] (Connection.java:748) [peer master-127.4.149.254:41393(127.4.149.254:41393)] connecting to peer
23:49:34.775 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.775 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.149.252:44265(127.4.149.252:44265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.775 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.775 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.252:44265: Failed to connect to peer master-127.4.149.252:44265(127.4.149.252:44265): Connection refused: /127.4.149.252:44265
23:49:34.775 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.149.253:38083(127.4.149.253:38083)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.775 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.253:38083: Failed to connect to peer master-127.4.149.253:38083(127.4.149.253:38083): Connection refused: /127.4.149.253:38083
23:49:34.775 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.149.254:41393(127.4.149.254:41393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.776 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.149.254:41393: Failed to connect to peer master-127.4.149.254:41393(127.4.149.254:41393): Connection refused: /127.4.149.254:41393
23:49:34.776 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.149.252:44265,127.4.149.253:38083,127.4.149.254:41393; will retry
23:49:34.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.833 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:34.839 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.61:36251(127.9.248.61:36251)] connecting to peer
23:49:34.840 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.60:35483(127.9.248.60:35483)] connecting to peer
23:49:34.840 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.9.248.62:39393(127.9.248.62:39393)] connecting to peer
23:49:34.840 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:34.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.60:35483(127.9.248.60:35483)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:34.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:34.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.62:39393(127.9.248.62:39393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:34.840 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.60:35483: Failed to connect to peer master-127.9.248.60:35483(127.9.248.60:35483): Connection refused: /127.9.248.60:35483
23:49:34.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.62:39393: Failed to connect to peer master-127.9.248.62:39393(127.9.248.62:39393): Connection refused: /127.9.248.62:39393
23:49:34.840 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:34.840 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.61:36251(127.9.248.61:36251)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:34.841 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.61:36251: Failed to connect to peer master-127.9.248.61:36251(127.9.248.61:36251): Connection refused: /127.9.248.61:36251
23:49:34.841 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.61:36251,127.9.248.60:35483,127.9.248.62:39393; will retry
23:49:34.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468174888 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:34.897 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
23:49:34.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
23:49:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.954156 13392 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 13964
23:49:34.981 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:34.981 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:34.981 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:34.982 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.982 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.982 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.982 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.982 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:34.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.982 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:34.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:34.982 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:34.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:34.988639 13494 connection.cc:573] server connection from 127.13.20.3:34423 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:34.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:34.988860 13424 connection.cc:573] server connection from 127.13.20.3:53825 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:34.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.989172 13392 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 13408
23:49:34.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:34.990676 13469 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:34.991 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468174990 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:35.001 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.002 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 2f60d89f2ad64c6df931fae26fa623f3 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
23:49:35.003 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
23:49:35.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.130957 13392 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 13408
23:49:35.139 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.125:34537(127.2.216.125:34537)] connecting to peer
23:49:35.139 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.124:33041(127.2.216.124:33041)] connecting to peer
23:49:35.139 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.2.216.126:46485(127.2.216.126:46485)] connecting to peer
23:49:35.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:35.140 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.216.125:34537(127.2.216.125:34537)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:35.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:35.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:35.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.216.124:33041(127.2.216.124:33041)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:35.140 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.125:34537: Failed to connect to peer master-127.2.216.125:34537(127.2.216.125:34537): Connection refused: /127.2.216.125:34537
23:49:35.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.216.126:46485(127.2.216.126:46485)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:35.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.126:46485: Failed to connect to peer master-127.2.216.126:46485(127.2.216.126:46485): Connection refused: /127.2.216.126:46485
23:49:35.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.216.124:33041: Failed to connect to peer master-127.2.216.124:33041(127.2.216.124:33041): Connection refused: /127.2.216.124:33041
23:49:35.140 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.216.125:34537,127.2.216.124:33041,127.2.216.126:46485; will retry
23:49:35.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.157 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.20.62:35095(127.13.20.62:35095)] handling channelInactive
23:49:35.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.156962 13392 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 13476
23:49:35.157 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.20.62:35095(127.13.20.62:35095)] cleaning up while in state READY due to: connection closed
23:49:35.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.158361 13540 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:35.167 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.252:44235(127.8.22.252:44235)] connecting to peer
23:49:35.168 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.253:33181(127.8.22.253:33181)] connecting to peer
23:49:35.168 [DEBUG - pool-241-thread-1] (Connection.java:748) [peer master-127.8.22.254:45201(127.8.22.254:45201)] connecting to peer
23:49:35.168 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:35.168 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.8.22.252:44235(127.8.22.252:44235)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:35.168 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:35.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:35.168 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.252:44235: Failed to connect to peer master-127.8.22.252:44235(127.8.22.252:44235): Connection refused: /127.8.22.252:44235
23:49:35.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.8.22.254:45201(127.8.22.254:45201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:35.168 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.8.22.253:33181(127.8.22.253:33181)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:35.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.254:45201: Failed to connect to peer master-127.8.22.254:45201(127.8.22.254:45201): Connection refused: /127.8.22.254:45201
23:49:35.168 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.8.22.253:33181: Failed to connect to peer master-127.8.22.253:33181(127.8.22.253:33181): Connection refused: /127.8.22.253:33181
23:49:35.169 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.8.22.252:44235,127.8.22.253:33181,127.8.22.254:45201; will retry
23:49:35.240 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.188:35043(127.9.73.188:35043)] connecting to peer
23:49:35.240 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.189:33103(127.9.73.189:33103)] connecting to peer
23:49:35.240 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.9.73.190:40177(127.9.73.190:40177)] connecting to peer
23:49:35.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:35.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:35.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.73.188:35043(127.9.73.188:35043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:35.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.73.189:33103(127.9.73.189:33103)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:35.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.188:35043: Failed to connect to peer master-127.9.73.188:35043(127.9.73.188:35043): Connection refused: /127.9.73.188:35043
23:49:35.241 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.189:33103: Failed to connect to peer master-127.9.73.189:33103(127.9.73.189:33103): Connection refused: /127.9.73.189:33103
23:49:35.241 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:35.241 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.73.190:40177(127.9.73.190:40177)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:35.241 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.73.190:40177: Failed to connect to peer master-127.9.73.190:40177(127.9.73.190:40177): Connection refused: /127.9.73.190:40177
23:49:35.241 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.73.188:35043,127.9.73.189:33103,127.9.73.190:40177; will retry
23:49:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.282847 13392 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 13476
23:49:35.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:35.307365 13568 connection.cc:573] client connection to 127.13.20.61:45687 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:35.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.307646 13392 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu pid 13547
23:49:35.307 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.20.61:45687(127.13.20.61:45687)] handling channelInactive
23:49:35.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.20.61:45687(127.13.20.61:45687)] cleaning up while in state READY due to: connection closed
23:49:35.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:49:35.307729 13568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
23:49:35.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.309072 13612 generic_service.cc:196] Checking for leaks (request via RPC)
23:49:35.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job bbc34d76ac15add629743db00c4f4a33 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job bbc34d76ac15add629743db00c4f4a33 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.333 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6446e0085b210020482ce7a622d23630 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6446e0085b210020482ce7a622d23630 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.389 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468175388 for job 5a3070dbdd20ce404be391e5224b50fa.
23:49:35.397 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 5a3070dbdd20ce404be391e5224b50fa (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
23:49:35.397 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
23:49:35.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:49:35.437062 13392 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZ1k3RW/build/asan/bin/kudu with pid 13547
23:49:35.464 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.20.60:44081(127.13.20.60:44081)] handling channelInactive
23:49:35.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.20.60:44081(127.13.20.60:44081)] cleaning up while in state READY due to: connection closed
23:49:35.491 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783468175490 for job 2f60d89f2ad64c6df931fae26fa623f3.
23:49:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:49:35Z chronyd exiting
23:49:35.500 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 2f60d89f2ad64c6df931fae26fa623f3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
23:49:35.501 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
23:49:35.501 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b15b774f375318429e8c166741c1d9d since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b15b774f375318429e8c166741c1d9d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.517 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.125:39367(127.6.114.125:39367)] connecting to peer
23:49:35.518 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.126:40573(127.6.114.126:40573)] connecting to peer
23:49:35.518 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.6.114.124:34801(127.6.114.124:34801)] connecting to peer
23:49:35.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:35.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.114.125:39367(127.6.114.125:39367)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:35.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.125:39367: Failed to connect to peer master-127.6.114.125:39367(127.6.114.125:39367): Connection refused: /127.6.114.125:39367
23:49:35.519 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:35.519 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.114.124:34801(127.6.114.124:34801)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:35.519 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.124:34801: Failed to connect to peer master-127.6.114.124:34801(127.6.114.124:34801): Connection refused: /127.6.114.124:34801
23:49:35.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:35.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.114.126:40573(127.6.114.126:40573)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:35.519 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.114.126:40573: Failed to connect to peer master-127.6.114.126:40573(127.6.114.126:40573): Connection refused: /127.6.114.126:40573
23:49:35.519 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.114.125:39367,127.6.114.126:40573,127.6.114.124:34801; will retry
23:49:35.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c4b00a34e6633561fb08795709e8dcd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c4b00a34e6633561fb08795709e8dcd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.540 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.124:40929(127.5.195.124:40929)] connecting to peer
23:49:35.540 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.126:36941(127.5.195.126:36941)] connecting to peer
23:49:35.540 [DEBUG - pool-296-thread-1] (Connection.java:748) [peer master-127.5.195.125:41211(127.5.195.125:41211)] connecting to peer
23:49:35.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:35.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.195.124:40929(127.5.195.124:40929)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:35.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:35.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.195.126:36941(127.5.195.126:36941)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:35.541 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.124:40929: Failed to connect to peer master-127.5.195.124:40929(127.5.195.124:40929): Connection refused: /127.5.195.124:40929
23:49:35.541 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.126:36941: Failed to connect to peer master-127.5.195.126:36941(127.5.195.126:36941): Connection refused: /127.5.195.126:36941
23:49:35.541 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:35.541 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.195.125:41211(127.5.195.125:41211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:35.541 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.195.125:41211: Failed to connect to peer master-127.5.195.125:41211(127.5.195.125:41211): Connection refused: /127.5.195.125:41211
23:49:35.541 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.195.124:40929,127.5.195.126:36941,127.5.195.125:41211; will retry

Time: 123.887

OK (7 tests)

23:49:35.627 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
23:49:35.629 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:36267
23:49:35.629 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:35925
23:49:35.629 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-871b1c5e-9646-463c-8acf-82589e20410d
23:49:35.629 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-c73963f3-fd87-49d4-9e63-a71ef97a3163
23:49:35.631 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
23:49:35.631 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
23:49:35.631 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
23:49:35.632 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-bb83c92b-a584-49b9-a4f8-c45018236565
23:49:35.633 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
23:49:35.633 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:45303
23:49:35.634 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
23:49:35.634 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:34215
23:49:35.635 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:32973
23:49:35.640 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-2a7e1eff-01cc-40ac-a993-cf36afa7f77f
23:49:35.641 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-2811c08a-9b94-41f9-a2bf-1733ecb1ea47
23:49:35.641 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-620c1253-d135-4f91-a463-14e249652635
23:49:35.642 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
23:49:35.642 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
23:49:35.643 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
23:49:35.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 86e770137b663b638a7b0ce49d5c917b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 86e770137b663b638a7b0ce49d5c917b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
23:49:35.644 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-0af666d2-7af0-46c3-b687-ef0e425f8776
23:49:35.645 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
23:49:35.645 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-ffcca8d1-7b35-4fed-a278-ffa44c359fdf
23:49:35.646 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
23:49:35.647 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-c199c989-5fdb-46a2-b873-7f986a5b9861
23:49:35.647 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
23:49:35.648 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-dc185468-5706-4838-b07c-e4919e6ab0be
